-- Logs begin at Mon 2022-07-25 21:42:08 UTC, end at Mon 2022-07-25 23:27:38 UTC. -- Jul 25 22:54:23.302155 dv-cinder-797608-63-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 25 22:54:23.311344 dv-cinder-797608-63-iscsi devstack@n-api.service[103613]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 25 22:54:23.314137 dv-cinder-797608-63-iscsi devstack@n-api.service[103613]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 22:54:23 2022] *** Jul 25 22:54:23.314137 dv-cinder-797608-63-iscsi devstack@n-api.service[103613]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 22:54:23.314137 dv-cinder-797608-63-iscsi devstack@n-api.service[103613]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 22:54:23.314137 dv-cinder-797608-63-iscsi devstack@n-api.service[103613]: nodename: dv-cinder-797608-63-iscsi Jul 25 22:54:23.314137 dv-cinder-797608-63-iscsi devstack@n-api.service[103613]: machine: x86_64 Jul 25 22:54:23.314137 dv-cinder-797608-63-iscsi devstack@n-api.service[103613]: clock source: unix Jul 25 22:54:23.314137 dv-cinder-797608-63-iscsi devstack@n-api.service[103613]: pcre jit disabled Jul 25 22:54:23.314137 dv-cinder-797608-63-iscsi devstack@n-api.service[103613]: detected number of CPU cores: 4 Jul 25 22:54:23.314137 dv-cinder-797608-63-iscsi devstack@n-api.service[103613]: current working directory: / Jul 25 22:54:23.314137 dv-cinder-797608-63-iscsi devstack@n-api.service[103613]: detected binary path: /usr/bin/uwsgi-core Jul 25 22:54:23.314137 dv-cinder-797608-63-iscsi devstack@n-api.service[103613]: your processes number limit is 47680 Jul 25 22:54:23.314137 dv-cinder-797608-63-iscsi devstack@n-api.service[103613]: your memory page size is 4096 bytes Jul 25 22:54:23.314137 dv-cinder-797608-63-iscsi devstack@n-api.service[103613]: detected max file descriptor number: 2048 Jul 25 22:54:23.314137 dv-cinder-797608-63-iscsi devstack@n-api.service[103613]: lock engine: pthread robust mutexes Jul 25 22:54:23.315290 dv-cinder-797608-63-iscsi devstack@n-api.service[103613]: thunder lock: enabled Jul 25 22:54:23.315290 dv-cinder-797608-63-iscsi devstack@n-api.service[103613]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 25 22:54:23.315290 dv-cinder-797608-63-iscsi devstack@n-api.service[103613]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 22:54:23.354184 dv-cinder-797608-63-iscsi devstack@n-api.service[103613]: Python main interpreter initialized at 0x55f413bff9c0 Jul 25 22:54:23.354184 dv-cinder-797608-63-iscsi devstack@n-api.service[103613]: python threads support enabled Jul 25 22:54:23.354184 dv-cinder-797608-63-iscsi devstack@n-api.service[103613]: your server socket listen backlog is limited to 100 connections Jul 25 22:54:23.354184 dv-cinder-797608-63-iscsi devstack@n-api.service[103613]: your mercy for graceful operations on workers is 90 seconds Jul 25 22:54:23.354628 dv-cinder-797608-63-iscsi devstack@n-api.service[103613]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 22:54:23.354628 dv-cinder-797608-63-iscsi devstack@n-api.service[103613]: *** Operational MODE: preforking *** Jul 25 22:54:23.354918 dv-cinder-797608-63-iscsi devstack@n-api.service[103613]: *** uWSGI is running in multiple interpreter mode *** Jul 25 22:54:23.354918 dv-cinder-797608-63-iscsi devstack@n-api.service[103613]: spawned uWSGI master process (pid: 103613) Jul 25 22:54:23.355144 dv-cinder-797608-63-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 25 22:54:23.356027 dv-cinder-797608-63-iscsi devstack@n-api.service[103613]: spawned uWSGI worker 1 (pid: 103614, cores: 1) Jul 25 22:54:23.356027 dv-cinder-797608-63-iscsi devstack@n-api.service[103613]: spawned uWSGI worker 2 (pid: 103615, cores: 1) Jul 25 22:54:23.356219 dv-cinder-797608-63-iscsi devstack@n-api.service[103613]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 22:54:24.064521 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 22:54:24.121183 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 22:54:25.201761 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 22:54:25.201761 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: from cryptography.utils import int_from_bytes Jul 25 22:54:25.202670 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 22:54:25.202670 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: from cryptography.utils import int_from_bytes Jul 25 22:54:25.230251 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 22:54:25.230251 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: from cryptography.utils import int_from_bytes Jul 25 22:54:25.231145 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 22:54:25.231145 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: from cryptography.utils import int_from_bytes Jul 25 22:54:27.831613 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 22:54:27.832314 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 22:54:27.832467 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 22:54:27.832748 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 22:54:27.833007 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 22:54:27.833427 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.833753 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.833875 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 22:54:27.834303 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 22:54:27.834416 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.834416 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.834582 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 22:54:27.834725 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.834947 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 22:54:27.835047 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.835201 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 22:54:27.835290 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.835586 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.835674 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.835909 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.836001 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.836172 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.836272 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.836486 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.836575 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.836809 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-63-iscsi {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.836897 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.837146 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.837258 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.837473 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.837562 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.837786 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.837874 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.838105 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.838202 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.838359 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.838458 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.838671 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.838759 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.838999 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-63-iscsi {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.839165 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.839301 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.839571 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.839760 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.839908 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.840062 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.840210 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.840355 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.840498 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.840622 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.840805 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.840933 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.841365 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.841515 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.841641 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.841767 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.841959 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.842101 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.842235 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.842381 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.842521 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.842649 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.842888 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.843041 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.843185 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-63-iscsi {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.843325 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.844105 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.844304 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.844447 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.844575 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.844713 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.844853 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.844989 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.844989 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.845291 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.845420 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.845545 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.845693 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.845819 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-63-iscsi {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.845963 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.846102 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.846232 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.846370 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.846501 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.846627 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.846770 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.846899 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.847034 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.848073 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.848307 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.848540 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.848782 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.848996 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.849245 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.849460 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.849671 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.849903 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.850126 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.850345 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.850573 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.850788 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.851009 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.851245 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.851467 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.851693 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.851905 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.852120 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.852330 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.852592 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.852802 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.853016 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.853320 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.853555 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.853759 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.853910 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.854099 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.854305 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.854490 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.854705 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.854925 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.855138 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.855305 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.855447 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.855618 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.855775 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.855937 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.856142 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.856310 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.856576 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.856796 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.857033 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.857307 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.857540 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.857782 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.858022 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.858790 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.859490 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.859652 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.860111 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.860906 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.861075 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.861278 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.861482 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.861640 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.861787 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.861936 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.861936 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.862226 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.862374 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.862521 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.862680 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.862857 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.863016 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.863161 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.863307 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.863451 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.863616 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.863779 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.863926 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.864069 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.864214 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.864411 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.864411 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.864735 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.864735 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.864997 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.864997 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.865290 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.865450 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.865450 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.865729 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.865881 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.865881 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.866157 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.866299 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.866299 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.866644 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.866802 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.866946 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.867089 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.867089 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.867381 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.867526 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.867526 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.867791 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.867933 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.867933 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.868278 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.868646 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.868646 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.868929 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.869370 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.869370 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.869722 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.869868 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.869868 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.870143 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.870295 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.870450 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.870606 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.870606 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.870878 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.871020 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.871175 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.871329 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.871329 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.871593 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.871751 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.871751 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.872021 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.872178 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.872178 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.872454 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.872597 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.872597 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.872868 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.873021 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.873021 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.873329 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.873481 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.873635 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.873900 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.873900 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.874176 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.874318 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.874318 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.874655 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.875340 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.875340 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.876109 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.876365 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.876365 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.876636 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.876799 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.876941 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.877084 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.877084 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.877454 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.877598 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.877598 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.877882 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.878023 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.878023 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.878287 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.878501 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.878501 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.878999 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.879143 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.879143 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.879417 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.879417 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.879698 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.879698 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.879970 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.880110 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.880110 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.880383 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.880533 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.880673 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.880829 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.880829 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.881113 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.881312 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.881312 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.881588 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.881729 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.881729 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.882029 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.882185 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.882327 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.882470 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.882470 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.882799 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.882943 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.882943 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.883243 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.883386 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.883386 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.883661 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.883823 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.883965 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.884110 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.884110 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.884396 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.884541 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.884541 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.884827 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.884976 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.885141 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.885357 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.885357 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.886335 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.886506 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.886506 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.886790 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.886935 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.887078 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.887235 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.887402 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.887545 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.887696 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.887839 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.888002 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.888144 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.888144 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.888404 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.888547 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.888547 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.889090 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.889337 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.889480 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.889755 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.889755 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.890070 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.890227 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.890478 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.891587 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.891587 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.891867 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.892011 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.892011 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.892298 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.892522 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.892522 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.892811 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.892954 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.893110 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.893300 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.893300 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.893613 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.893759 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.893902 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.894056 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.894056 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.894358 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 22:54:27.894501 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.894501 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.894775 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.894938 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.894938 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.895248 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.895404 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.895404 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.895679 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.895820 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.895987 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.896142 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.896284 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.896421 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.896608 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.896788 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.896986 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.897166 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.897415 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.897562 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.897733 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.898011 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.898187 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.898387 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.898546 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.898801 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.899234 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.899383 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.899527 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.899695 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.899837 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.900041 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.900184 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.900341 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.900570 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.900719 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.900893 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.901211 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.901361 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.901573 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.901833 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.901986 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.902273 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.902469 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.902683 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.902999 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.903155 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.903418 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.903670 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.903859 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.904051 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.904228 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.904483 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.904633 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.904796 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.905056 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.905230 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.905462 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.905751 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.905969 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.906875 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.907061 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.907209 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.907430 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.907577 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.907577 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.907858 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.908000 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.908000 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.908265 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.908429 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.908429 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.908723 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.908878 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.909103 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.909456 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.909604 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.909604 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.909898 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.910043 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.910182 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.910320 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.910463 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.910752 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.910873 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.911116 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.911218 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.911435 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.911540 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.911812 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.911908 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.912127 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.912271 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.912689 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.913003 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.913188 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.913340 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.913605 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.913782 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.913977 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.914161 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.914315 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.914647 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.914904 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.915088 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.915233 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.915401 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.915626 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.915778 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.915979 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.916263 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.916430 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.916627 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.916806 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.916951 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.917324 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.917531 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.917677 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.917917 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.918104 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.918252 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.918465 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.918618 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.918870 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.919019 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.919164 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.919478 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.919629 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.919771 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.920014 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.920168 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.920440 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.920603 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.920759 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.921051 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.921281 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.921430 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.922149 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.923192 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.923192 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.923470 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.923628 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.923628 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.923902 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.924046 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.924046 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.924348 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.924502 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.924502 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.924768 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.924913 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.925067 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.925265 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.925265 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.925529 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.925675 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.925865 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.926012 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.926169 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.926506 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.926662 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.926806 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.927033 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.927185 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.927429 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.927578 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.927722 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.928035 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.928185 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.928343 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.928572 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.928724 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.928974 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.929284 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.929487 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.929707 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.929863 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.930007 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.930148 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.930291 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.930553 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.930714 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.930860 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.931132 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.931285 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.931427 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.931666 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.931840 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.932055 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.932201 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.932343 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.932649 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.932800 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.932968 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.933216 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.933462 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.933706 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.933859 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.934081 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.934228 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.934402 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.934710 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.934864 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.935008 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.935242 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.935396 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.935637 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.935784 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.935929 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.936248 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.936523 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.936669 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.936807 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.936950 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.937195 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.938775 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.939097 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.939097 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.939367 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.939524 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.939524 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.939767 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.939896 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.939896 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.940173 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.940313 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.940313 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.940588 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.940729 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.940883 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.941028 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.941348 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.941520 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.941797 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.941988 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.942208 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.942380 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.942531 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.942722 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.942916 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.943081 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.943357 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.943507 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.943682 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.943916 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.944070 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.944319 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.944478 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.944640 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.944904 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.945059 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.945253 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.945458 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.945610 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.945823 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.945969 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.946125 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.946420 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.946568 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.946723 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.946971 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.947122 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.947305 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.947510 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.947660 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.947907 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.948055 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.948219 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.948496 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.948722 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.948882 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.949021 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.949192 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.949443 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.949609 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.949820 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.950040 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.950187 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.950330 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.950631 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.950793 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.950972 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.951202 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.951355 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.951608 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.951757 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.951980 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.952235 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.952388 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.952544 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.952797 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.952953 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.954125 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.954275 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.954430 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.954430 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.954720 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.954919 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.954919 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.955196 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.955352 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.955352 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.955616 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.955773 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.955773 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.956034 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.956176 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.956319 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.956459 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.956459 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.956734 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.956875 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.957249 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.957403 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.957565 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.957722 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.957879 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.958033 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.958278 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.958428 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.958588 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.958808 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.958972 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.959162 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.959360 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.959511 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.959755 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.959959 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.960142 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.960359 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.960507 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.960650 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.960934 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.961100 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.961358 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.961533 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.961727 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.961872 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.962093 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.962333 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.962594 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.962758 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.962938 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.963142 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.963293 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.963539 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.963696 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.963841 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.964127 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.964291 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.964435 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.964660 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.964822 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.965049 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.965281 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.965437 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.965675 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.965822 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.965964 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.966214 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.966366 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.966580 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.966753 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.966902 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.967236 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.967390 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.967577 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.967778 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.967930 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.968172 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.968757 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.969719 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.969886 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.970030 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.970030 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.970263 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.970405 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.970405 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.970756 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.970903 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.970903 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.971163 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.971306 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.971449 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.971611 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.971611 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.971933 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.972078 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.972078 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.972351 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.972506 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.972659 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.972810 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.972952 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.973288 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.973460 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.973619 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.973829 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.973981 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.974204 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.974351 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.974508 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.974801 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.974951 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.975123 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.975357 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.975508 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.975734 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.975881 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.976054 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.976360 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.976513 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.976689 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.976907 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.977059 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.977401 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.977555 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.977795 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.977955 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.978111 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.978406 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.978621 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.978783 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.978957 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.979129 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.979312 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.979502 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.979652 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.979927 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.980075 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.980234 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.980504 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.980657 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.980829 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.981043 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.981255 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.981461 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.981633 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.981783 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.982088 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.982241 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.982405 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.982638 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.982804 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.982978 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.983193 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.983343 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.983580 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.983726 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.984695 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.985711 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.985862 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.985862 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.986151 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.986295 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.986295 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.986558 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.986701 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.986843 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.986997 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.986997 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.987276 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.987418 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.987562 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.987716 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.987861 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.988083 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.988237 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.988411 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.988619 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.988839 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.989005 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.989252 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.989398 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.989688 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.989840 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.990026 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.990235 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.990385 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.990645 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.990780 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.990947 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.991255 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.991408 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.991574 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.991789 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.991990 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.992278 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.992442 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.992603 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.992828 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.992980 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.993327 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.993510 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.993803 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.993955 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.994123 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.994343 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.994495 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.994756 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.994905 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.995048 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.995338 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.995493 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.995664 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.995880 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.996032 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.996301 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.996449 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.996593 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.996887 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.997038 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.997326 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.997476 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.997681 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.997933 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.998099 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.998306 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.998453 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.998626 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.998969 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.999190 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.999352 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.999503 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:27.999704 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.000624 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.001672 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.001821 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.001990 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.001990 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.002257 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.002385 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.002385 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.002626 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.002753 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.002753 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.003033 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.003162 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.003364 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.003564 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.003799 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.003950 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.004094 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.004404 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.004555 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.004722 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.004953 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.005156 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.005336 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.005561 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.005731 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.006010 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.006166 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.006309 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.006580 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.006730 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.006950 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.007098 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.007255 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.007560 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.007713 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.007857 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.008091 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.008246 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.008443 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.008633 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.008918 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.009155 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.009294 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.009589 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.009738 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.009897 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.010191 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.010372 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.010528 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.010724 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.010877 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.011181 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.011333 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.011487 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.011736 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.011903 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.012117 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.012275 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.012419 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.012710 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.012874 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.013020 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.013286 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.013439 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.013629 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.013828 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.013992 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.014230 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.014392 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.014536 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.014823 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.014972 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.015130 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.015397 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.015534 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.016556 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.016720 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.016866 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.016866 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.017201 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.017345 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.017490 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.017631 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.017631 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.017937 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.018102 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.018102 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.018375 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.018521 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.018710 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.018857 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.019032 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.019293 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.019445 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.019660 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.019861 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.020066 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.020518 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.020677 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.020821 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.020963 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.021154 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.021302 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.021520 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.021683 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.021946 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.022115 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.022260 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.022476 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.022625 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.022790 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.023047 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.023212 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.023410 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.023595 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.023994 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.024147 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.024322 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.024537 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.024706 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.024936 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.025083 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.025386 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.025582 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.025744 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.025889 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.026159 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.026325 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.026469 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.026697 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.026898 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.027189 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.027332 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.027474 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.027684 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.027844 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.028003 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.028251 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.028404 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.028640 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.028790 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.028946 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.029280 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.029435 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.029599 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.029797 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.029950 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.030250 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.030410 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.030565 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.030787 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.030966 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.031869 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.032095 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.032277 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.032432 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.032695 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.032895 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.033045 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.033045 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.033339 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.033482 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.033482 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.033748 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.033891 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.034034 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.034189 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.034335 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.034565 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.034719 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.034977 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.035139 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.035283 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.035550 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.035705 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.035909 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.036083 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.036246 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.036556 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.036797 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.037061 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.037344 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.037860 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.038029 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.038249 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.038406 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.038580 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.038866 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.039020 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.039194 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.039402 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.039557 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.039830 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.040051 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.040211 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.040414 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.040576 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.040723 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.040932 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.041085 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.041347 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.041524 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.041668 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.041960 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.042162 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.042314 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.042532 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.042686 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.043004 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.043187 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.043481 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.043635 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.043853 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.044011 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.044182 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.044475 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.044642 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.044803 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.045014 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.045235 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.045447 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.045614 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.045758 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.046036 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.046192 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.046338 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.047132 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.048079 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.048079 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.048365 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.048529 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.048529 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.048791 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.048935 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.048935 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.049235 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.049377 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.049377 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.049630 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.049782 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.049939 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.050068 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.050197 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.050361 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.050565 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.050784 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.050952 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.051112 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.051425 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.051582 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.051728 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.051955 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.052117 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.052378 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.052533 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.052676 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.052981 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.053192 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.053343 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.053552 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.053705 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.053889 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.054104 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.054268 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.054534 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.054683 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.054859 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.055106 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.055274 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.055486 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.055660 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.055812 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.056053 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.056212 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.056357 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.056665 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.056817 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.056961 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.057228 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.057383 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.057648 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.057818 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.058174 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.058325 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.058561 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.058709 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.058866 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.059175 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.059340 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.059523 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.059715 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.059865 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.060223 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.060366 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.060611 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.060813 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.060965 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.061265 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.061443 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.061590 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.061820 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.061975 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.062230 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.063089 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.064062 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.064062 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.064336 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.064561 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.064561 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.064853 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.065000 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.065000 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.065318 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.065463 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.065610 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.065862 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.065862 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.066128 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.066269 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.066440 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.066639 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.066800 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.066937 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.067186 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.067334 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.067507 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.067802 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.067957 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.068114 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.068341 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.068494 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.068725 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.068891 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.069038 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.069367 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.069529 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.069700 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.069918 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.070085 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.070313 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.070514 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.070752 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.070952 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.071112 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.071419 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.071570 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.071744 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.071954 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.072106 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.072370 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.072535 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.072682 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.072967 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.073166 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.073314 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.073538 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.073677 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.073940 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.074091 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.074282 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.074612 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.074777 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.074999 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.075217 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.075369 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.075519 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.075753 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.075904 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.076107 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.076284 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.076447 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.076726 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.076896 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.077053 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.077495 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.077672 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.077672 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.077946 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.078396 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.078396 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.079265 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.079410 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.079410 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.079689 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.079846 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.079846 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.080114 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.080267 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.080267 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.080558 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.080698 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.080826 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.080967 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.081213 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.081360 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.081529 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.081740 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.081929 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.082078 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.082235 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.082474 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.082625 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.082802 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.083011 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.083238 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.083457 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.083619 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.083815 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.084060 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.084214 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.084525 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.084680 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.084839 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.085050 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.085278 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.085484 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.085654 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.085796 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.085958 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.086095 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.086236 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.086416 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.086739 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.086881 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.087026 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.087261 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.087415 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.087639 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.087788 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.087945 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.088247 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.088435 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.088583 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.088907 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.089063 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.089377 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.089546 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.089692 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.089947 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.090102 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.090296 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.090502 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.090665 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.090925 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.091074 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.091401 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.091565 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.091724 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.092010 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.092164 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.092337 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.092554 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.092808 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.092955 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.093146 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.093296 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.094216 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.094412 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.094760 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.094927 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.095091 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.095325 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.095504 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.095645 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.095833 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.095988 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.096168 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.096331 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.096502 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.096664 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.096819 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.096960 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.097113 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.097411 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.097563 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.097724 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.097868 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.098043 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.098205 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.098377 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.098520 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.098709 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.098855 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.098997 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.099144 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.099347 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.099492 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.099654 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.099797 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.099947 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103615) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 22:54:28.100085 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.100225 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.100539 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.100844 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.101178 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.101494 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.101808 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.102113 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.102420 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.102740 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.103045 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.103368 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.103682 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.104002 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.104321 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.104624 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.104942 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.105277 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.105582 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.105886 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.106187 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.106547 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.106834 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.107156 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.107482 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.107803 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.108118 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.108454 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.108779 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.109659 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.110106 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.110687 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.111005 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.111308 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.111619 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.112028 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.112234 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.112534 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.112847 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.113214 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.113474 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.113777 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.114102 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.114401 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.114720 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.115023 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.115327 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.115628 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.115928 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.116271 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.116573 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.116904 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.117271 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.117573 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.117896 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.118204 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.118528 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.118841 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.119152 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.119463 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.119772 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.120081 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.120389 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.120694 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.121006 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.121344 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.121656 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.121969 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.122542 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.122882 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.123202 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.123513 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.123827 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.124137 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.124447 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.125406 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.125938 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.126439 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.126759 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.127093 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.127420 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.127744 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.128085 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.128406 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.128721 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.129104 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.129467 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.129832 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.130145 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.130453 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.130770 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.131083 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.131390 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.131700 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.132010 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.132330 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.132636 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.132944 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.133286 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.133589 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.133903 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.134223 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.134589 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.134910 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.135225 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.135532 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.135849 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.136420 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.136738 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.137070 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.137421 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.137742 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.138060 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.138377 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.138704 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.139012 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.139316 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.139627 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.139938 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.140275 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.141246 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.141772 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.142150 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.142474 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.142788 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.143365 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.143717 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.144036 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.144362 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.144684 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.144999 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.145334 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.145655 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.145964 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.146266 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.146580 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.146889 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.147189 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.147490 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.147798 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.148107 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.148405 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.148714 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.149016 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.149367 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.149666 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.150046 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.150754 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.150754 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.151023 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.151164 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.151426 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.151728 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.152039 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.152343 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.152650 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.152951 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.153290 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.153589 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.153896 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.154251 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.154579 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.154884 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.155182 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.155501 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.155811 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.156175 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.156697 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.157293 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.157619 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.157946 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.158547 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.158878 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.159209 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.159551 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.159880 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.160230 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.160594 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.160902 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.161262 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.161574 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.161889 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.162195 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.162763 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.163104 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.163415 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.163725 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.164052 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.164342 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.164647 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.164955 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.165291 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.165600 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.165917 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.166333 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.166669 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.166969 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.167283 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.167597 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.167904 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.168208 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.168518 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.168826 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.169164 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.169510 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.169823 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.170129 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.170562 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.170873 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.171192 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.171885 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.172235 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.172506 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.172967 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.173300 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.173628 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.173942 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.174272 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.174615 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.174942 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.175309 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.175617 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.175920 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.176221 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.176533 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.176856 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.177191 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.177496 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.177796 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.178104 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.178407 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.178709 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.179017 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.179316 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.179622 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.179925 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.180223 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.180584 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.180821 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.181171 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.181445 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.181753 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.182053 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.182355 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.182653 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.182952 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.183252 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.183587 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.183914 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.184229 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.184549 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.184860 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.185206 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.185518 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.185834 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.186176 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.186476 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.186780 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.187705 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.188106 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.188674 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.189039 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.189408 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.189726 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.190040 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.190380 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.190706 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.191009 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.191334 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.191654 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.191980 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.192301 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.192611 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.192974 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.193314 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.193627 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.193939 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.194250 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.194560 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.194876 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.195185 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.195493 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.195806 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.196125 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.196459 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.196783 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.197094 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.197456 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.197782 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.198145 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.198449 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.198796 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.199122 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.199437 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.199746 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.200049 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 22:54:28.200293 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103614) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 22:54:28.256839 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO dbcounter [None req-50e77440-0cc5-47bf-90fe-3324d1b62441 None None] Registered counter for database nova_api Jul 25 22:54:28.282338 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG oslo_db.sqlalchemy.engines [None req-50e77440-0cc5-47bf-90fe-3324d1b62441 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 22:54:28.290187 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG dbcounter [-] [103615] Writer thread running {{(pid=103615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 22:54:28.352691 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.context [None req-50e77440-0cc5-47bf-90fe-3324d1b62441 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),53652832-e111-499c-ae59-8d3f8dfe286d(cell1) {{(pid=103615) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 22:54:28.357098 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG oslo_concurrency.lockutils [None req-50e77440-0cc5-47bf-90fe-3324d1b62441 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 22:54:28.358746 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG oslo_concurrency.lockutils [None req-50e77440-0cc5-47bf-90fe-3324d1b62441 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 22:54:28.358998 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO dbcounter [None req-f7382135-0f22-469f-8ab1-f0f3f5317216 None None] Registered counter for database nova_api Jul 25 22:54:28.359623 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG oslo_concurrency.lockutils [None req-50e77440-0cc5-47bf-90fe-3324d1b62441 None None] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 22:54:28.361887 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG oslo_concurrency.lockutils [None req-50e77440-0cc5-47bf-90fe-3324d1b62441 None None] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 22:54:28.364040 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO dbcounter [None req-50e77440-0cc5-47bf-90fe-3324d1b62441 None None] Registered counter for database nova_cell0 Jul 25 22:54:28.370144 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO dbcounter [None req-50e77440-0cc5-47bf-90fe-3324d1b62441 None None] Registered counter for database nova_cell1 Jul 25 22:54:28.379339 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG oslo_db.sqlalchemy.engines [None req-50e77440-0cc5-47bf-90fe-3324d1b62441 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 22:54:28.381926 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG oslo_db.sqlalchemy.engines [None req-f7382135-0f22-469f-8ab1-f0f3f5317216 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103614) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 22:54:28.383875 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG oslo_db.sqlalchemy.engines [None req-50e77440-0cc5-47bf-90fe-3324d1b62441 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 22:54:28.388684 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG dbcounter [-] [103615] Writer thread running {{(pid=103615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 22:54:28.388900 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG dbcounter [-] [103614] Writer thread running {{(pid=103614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 22:54:28.395798 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG dbcounter [-] [103615] Writer thread running {{(pid=103615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 22:54:28.450751 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.context [None req-f7382135-0f22-469f-8ab1-f0f3f5317216 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),53652832-e111-499c-ae59-8d3f8dfe286d(cell1) {{(pid=103614) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 22:54:28.456069 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG oslo_concurrency.lockutils [None req-f7382135-0f22-469f-8ab1-f0f3f5317216 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 22:54:28.457744 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG oslo_concurrency.lockutils [None req-f7382135-0f22-469f-8ab1-f0f3f5317216 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 22:54:28.458650 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG oslo_concurrency.lockutils [None req-f7382135-0f22-469f-8ab1-f0f3f5317216 None None] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 22:54:28.460763 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG oslo_concurrency.lockutils [None req-f7382135-0f22-469f-8ab1-f0f3f5317216 None None] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103614) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 22:54:28.462970 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO dbcounter [None req-f7382135-0f22-469f-8ab1-f0f3f5317216 None None] Registered counter for database nova_cell0 Jul 25 22:54:28.469998 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO dbcounter [None req-f7382135-0f22-469f-8ab1-f0f3f5317216 None None] Registered counter for database nova_cell1 Jul 25 22:54:28.478025 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG oslo_db.sqlalchemy.engines [None req-f7382135-0f22-469f-8ab1-f0f3f5317216 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103614) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 22:54:28.480764 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG oslo_db.sqlalchemy.engines [None req-f7382135-0f22-469f-8ab1-f0f3f5317216 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103614) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 22:54:28.486102 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG dbcounter [-] [103614] Writer thread running {{(pid=103614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 22:54:28.489429 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG dbcounter [-] [103614] Writer thread running {{(pid=103614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 22:54:28.552955 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO dbcounter [None req-50e77440-0cc5-47bf-90fe-3324d1b62441 None None] Registered counter for database nova_cell0 Jul 25 22:54:28.565944 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG oslo_db.sqlalchemy.engines [None req-50e77440-0cc5-47bf-90fe-3324d1b62441 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103615) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 22:54:28.571953 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG dbcounter [-] [103615] Writer thread running {{(pid=103615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 22:54:28.647402 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO dbcounter [None req-f7382135-0f22-469f-8ab1-f0f3f5317216 None None] Registered counter for database nova_cell0 Jul 25 22:54:28.658115 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG oslo_db.sqlalchemy.engines [None req-f7382135-0f22-469f-8ab1-f0f3f5317216 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103614) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 22:54:28.664050 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG dbcounter [-] [103614] Writer thread running {{(pid=103614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 22:54:29.010705 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: WARNING keystonemiddleware.auth_token [None req-50e77440-0cc5-47bf-90fe-3324d1b62441 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 22:54:29.018933 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: WARNING keystonemiddleware.auth_token [None req-50e77440-0cc5-47bf-90fe-3324d1b62441 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 22:54:29.090103 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: WARNING keystonemiddleware.auth_token [None req-f7382135-0f22-469f-8ab1-f0f3f5317216 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 22:54:29.098329 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: WARNING keystonemiddleware.auth_token [None req-f7382135-0f22-469f-8ab1-f0f3f5317216 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 22:54:29.365755 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: WARNING keystonemiddleware.auth_token [None req-50e77440-0cc5-47bf-90fe-3324d1b62441 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 22:54:29.372128 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: WARNING keystonemiddleware.auth_token [None req-50e77440-0cc5-47bf-90fe-3324d1b62441 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 22:54:29.378380 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f413bff9c0 pid: 103615 (default app) Jul 25 22:54:29.380659 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-50e77440-0cc5-47bf-90fe-3324d1b62441 None None] Calling method '>' {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:54:29.381899 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-50e77440-0cc5-47bf-90fe-3324d1b62441 None None] 10.222.0.55 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001930 Jul 25 22:54:29.382343 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 1/1] 10.222.0.55 () {50 vars in 788 bytes} [Mon Jul 25 22:54:29 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 22:54:29.457284 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: WARNING keystonemiddleware.auth_token [None req-f7382135-0f22-469f-8ab1-f0f3f5317216 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 22:54:29.463407 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: WARNING keystonemiddleware.auth_token [None req-f7382135-0f22-469f-8ab1-f0f3f5317216 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 22:54:29.470007 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f413bff9c0 pid: 103614 (default app) Jul 25 22:56:00.573710 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-50e77440-0cc5-47bf-90fe-3324d1b62441 None None] Calling method '>' {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:56:00.576161 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-50e77440-0cc5-47bf-90fe-3324d1b62441 None None] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003088 Jul 25 22:56:00.577074 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 2/2] 10.222.0.55 () {54 vars in 930 bytes} [Mon Jul 25 22:56:00 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 22:56:00.598520 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG dbcounter [-] [103614] Writing DB stats nova_api:SELECT=3 {{(pid=103614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:00.599970 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG dbcounter [-] [103614] Writing DB stats nova_cell1:SELECT=3 {{(pid=103614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:00.601784 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG dbcounter [-] [103614] Writing DB stats nova_cell0:SELECT=3 {{(pid=103614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:00.603911 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG dbcounter [-] [103614] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:02.084911 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-77562eee-05f2-4c5d-96d6-64770f789034 admin admin] Calling method '>' {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:56:02.126269 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-77562eee-05f2-4c5d-96d6-64770f789034 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.536705 Jul 25 22:56:02.137957 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 1/3] 10.222.0.55 () {60 vars in 1291 bytes} [Mon Jul 25 22:56:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 22:56:04.774003 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-50e77440-0cc5-47bf-90fe-3324d1b62441 None None] Calling method '>' {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:56:04.775031 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-50e77440-0cc5-47bf-90fe-3324d1b62441 None None] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Jul 25 22:56:04.775668 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 3/4] 10.222.0.55 () {54 vars in 930 bytes} [Mon Jul 25 22:56:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 22:56:05.393878 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-33c33ab9-30f2-4491-9648-b1b79e704faa admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "cirros256", "ram": 256, "id": "c1"}} {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 22:56:05.416871 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:56:05.416871 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: warnings.warn(msg) Jul 25 22:56:05.606589 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-33c33ab9-30f2-4491-9648-b1b79e704faa admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.822386 Jul 25 22:56:05.643412 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 2/5] 10.222.0.55 () {64 vars in 1282 bytes} [Mon Jul 25 22:56:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 22:56:05.834084 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-ca4eba56-c08c-4c12-a3d5-d25d0def2313 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 22:56:05.838504 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:56:05.838504 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: warnings.warn(msg) Jul 25 22:56:05.855084 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG dbcounter [-] [103615] Writing DB stats nova_api:SELECT=3 {{(pid=103615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:05.856055 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG dbcounter [-] [103615] Writing DB stats nova_cell1:SELECT=3 {{(pid=103615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:05.856953 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG dbcounter [-] [103615] Writing DB stats nova_cell0:SELECT=3 {{(pid=103615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:05.857761 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG dbcounter [-] [103615] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:06.026646 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-ca4eba56-c08c-4c12-a3d5-d25d0def2313 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.410092 Jul 25 22:56:06.027236 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 4/6] 10.222.0.55 () {64 vars in 1335 bytes} [Mon Jul 25 22:56:05 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 22:56:08.408773 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-33c33ab9-30f2-4491-9648-b1b79e704faa admin admin] Calling method '>' {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:56:08.411538 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-33c33ab9-30f2-4491-9648-b1b79e704faa admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003320 Jul 25 22:56:08.413165 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 3/7] 10.222.0.55 () {54 vars in 930 bytes} [Mon Jul 25 22:56:08 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 22:56:09.256270 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-e5090f13-7ab0-4d4b-be9e-bac5a237b4dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 5, "id": "d1", "ram": 512, "os-flavor-access:is_public": true, "swap": 0, "name": "ds512M"}} {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 22:56:09.279617 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:56:09.279617 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: warnings.warn(msg) Jul 25 22:56:09.403541 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-e5090f13-7ab0-4d4b-be9e-bac5a237b4dd admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.978882 Jul 25 22:56:09.411545 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 5/8] 10.222.0.55 () {64 vars in 1282 bytes} [Mon Jul 25 22:56:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 22:56:09.420551 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-4e9eaa21-d692-45e3-a2c9-99654262d2db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 22:56:09.424903 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 22:56:09.424903 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: warnings.warn(msg) Jul 25 22:56:09.531453 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-4e9eaa21-d692-45e3-a2c9-99654262d2db admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.115745 Jul 25 22:56:09.532518 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 4/9] 10.222.0.55 () {64 vars in 1335 bytes} [Mon Jul 25 22:56:09 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 22:56:11.981843 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-e5090f13-7ab0-4d4b-be9e-bac5a237b4dd admin admin] Calling method '>' {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:56:11.982936 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-e5090f13-7ab0-4d4b-be9e-bac5a237b4dd admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002232 Jul 25 22:56:11.983516 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 6/10] 10.222.0.55 () {54 vars in 930 bytes} [Mon Jul 25 22:56:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 22:56:12.446569 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-7fb88b63-2792-48c0-8352-3d4ee2fe4ae3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds1G", "disk": 10, "rxtx_factor": 1.0, "ram": 1024, "id": "d2", "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 22:56:12.536728 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-7fb88b63-2792-48c0-8352-3d4ee2fe4ae3 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.546957 Jul 25 22:56:12.537439 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 5/11] 10.222.0.55 () {64 vars in 1282 bytes} [Mon Jul 25 22:56:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 22:56:12.551179 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-c91eb27e-08d5-4231-b1c6-e7cdaa00cb6d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 22:56:12.636462 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-c91eb27e-08d5-4231-b1c6-e7cdaa00cb6d admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088983 Jul 25 22:56:12.637292 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 7/12] 10.222.0.55 () {64 vars in 1335 bytes} [Mon Jul 25 22:56:12 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 22:56:15.050376 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-7fb88b63-2792-48c0-8352-3d4ee2fe4ae3 admin admin] Calling method '>' {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:56:15.051409 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-7fb88b63-2792-48c0-8352-3d4ee2fe4ae3 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jul 25 22:56:15.051905 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 6/13] 10.222.0.55 () {54 vars in 930 bytes} [Mon Jul 25 22:56:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 22:56:15.734332 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-36ec0948-6e48-4115-b388-2859f8a29434 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds2G", "ram": 2048, "id": "d3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 22:56:15.835922 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-36ec0948-6e48-4115-b388-2859f8a29434 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.777088 Jul 25 22:56:15.836896 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 8/14] 10.222.0.55 () {64 vars in 1282 bytes} [Mon Jul 25 22:56:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 22:56:15.865413 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-4d004703-ae7f-4e52-95ab-d23009f6cabf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 22:56:16.049169 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-4d004703-ae7f-4e52-95ab-d23009f6cabf admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.196180 Jul 25 22:56:16.057807 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 7/15] 10.222.0.55 () {64 vars in 1335 bytes} [Mon Jul 25 22:56:15 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 22:56:18.574744 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-36ec0948-6e48-4115-b388-2859f8a29434 admin admin] Calling method '>' {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:56:18.576693 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-36ec0948-6e48-4115-b388-2859f8a29434 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002734 Jul 25 22:56:18.577199 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 9/16] 10.222.0.55 () {54 vars in 930 bytes} [Mon Jul 25 22:56:18 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 22:56:19.170522 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-0d827e0d-f275-4ef3-bfa9-5a5a8c67a249 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "swap": 0, "vcpus": 4, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "name": "ds4G"}} {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 22:56:19.298123 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-0d827e0d-f275-4ef3-bfa9-5a5a8c67a249 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.714416 Jul 25 22:56:19.298683 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 8/17] 10.222.0.55 () {64 vars in 1282 bytes} [Mon Jul 25 22:56:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 22:56:19.311440 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-77b5ba90-a3ce-469c-8ed5-c96ab36e7366 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 22:56:19.405865 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-77b5ba90-a3ce-469c-8ed5-c96ab36e7366 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098151 Jul 25 22:56:19.429010 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 10/18] 10.222.0.55 () {64 vars in 1335 bytes} [Mon Jul 25 22:56:19 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 22:56:22.053799 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-0d827e0d-f275-4ef3-bfa9-5a5a8c67a249 admin admin] Calling method '>' {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:56:22.054854 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-0d827e0d-f275-4ef3-bfa9-5a5a8c67a249 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Jul 25 22:56:22.055311 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 9/19] 10.222.0.55 () {54 vars in 930 bytes} [Mon Jul 25 22:56:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 22:56:22.684299 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-c05153a7-ae5d-4459-bf5a-70dc70274ba5 admin admin] Calling method '>' {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:56:22.735972 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-c05153a7-ae5d-4459-bf5a-70dc70274ba5 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.671157 Jul 25 22:56:22.736906 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 11/20] 10.222.0.55 () {60 vars in 1291 bytes} [Mon Jul 25 22:56:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 22:56:25.505077 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-0d827e0d-f275-4ef3-bfa9-5a5a8c67a249 admin admin] Calling method '>' {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:56:25.506166 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-0d827e0d-f275-4ef3-bfa9-5a5a8c67a249 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001613 Jul 25 22:56:25.506595 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 10/21] 10.222.0.55 () {54 vars in 930 bytes} [Mon Jul 25 22:56:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 22:56:26.079493 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-2a96c2f4-03f8-49bf-8530-8462cbdc2f9c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "name": "m1.tiny", "id": "1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 22:56:26.214457 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-2a96c2f4-03f8-49bf-8530-8462cbdc2f9c admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.700026 Jul 25 22:56:26.216820 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 12/22] 10.222.0.55 () {64 vars in 1282 bytes} [Mon Jul 25 22:56:25 2022] POST /compute/v2.1/flavors => generated 402 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 22:56:26.230804 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-c2b775a5-2328-4145-97b2-ab85df0d2ce4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 22:56:26.357519 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-c2b775a5-2328-4145-97b2-ab85df0d2ce4 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.129441 Jul 25 22:56:26.357849 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 11/23] 10.222.0.55 () {64 vars in 1332 bytes} [Mon Jul 25 22:56:26 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 22:56:28.745247 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-2a96c2f4-03f8-49bf-8530-8462cbdc2f9c admin admin] Calling method '>' {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:56:28.746362 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-2a96c2f4-03f8-49bf-8530-8462cbdc2f9c admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001603 Jul 25 22:56:28.746852 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 13/24] 10.222.0.55 () {54 vars in 930 bytes} [Mon Jul 25 22:56:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 22:56:29.194943 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-2ab70913-4d85-4604-ab6f-fc4f11a321f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "ram": 2048, "id": "2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "disk": 20}} {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 22:56:29.323038 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-2ab70913-4d85-4604-ab6f-fc4f11a321f2 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.569237 Jul 25 22:56:29.323514 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 12/25] 10.222.0.55 () {64 vars in 1282 bytes} [Mon Jul 25 22:56:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 22:56:29.338585 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-5ca79d72-5a99-4f49-b582-1e6a16873942 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 22:56:29.483602 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-5ca79d72-5a99-4f49-b582-1e6a16873942 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.150236 Jul 25 22:56:29.484634 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 14/26] 10.222.0.55 () {64 vars in 1332 bytes} [Mon Jul 25 22:56:29 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 22:56:32.024834 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-2ab70913-4d85-4604-ab6f-fc4f11a321f2 admin admin] Calling method '>' {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:56:32.026758 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-2ab70913-4d85-4604-ab6f-fc4f11a321f2 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002613 Jul 25 22:56:32.027516 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 13/27] 10.222.0.55 () {54 vars in 930 bytes} [Mon Jul 25 22:56:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 22:56:32.632568 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-6a3bc378-576a-4944-8d5b-d20fa257221e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2, "name": "m1.medium", "id": "3", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 22:56:32.764877 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-6a3bc378-576a-4944-8d5b-d20fa257221e admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.726282 Jul 25 22:56:32.765625 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 15/28] 10.222.0.55 () {64 vars in 1282 bytes} [Mon Jul 25 22:56:32 2022] POST /compute/v2.1/flavors => generated 406 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 22:56:32.779158 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-a6665843-0c0e-418f-ace1-f2ecbc0169b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 22:56:32.784381 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG dbcounter [-] [103614] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=103614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:32.882748 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-a6665843-0c0e-418f-ace1-f2ecbc0169b5 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108056 Jul 25 22:56:32.884444 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 14/29] 10.222.0.55 () {64 vars in 1332 bytes} [Mon Jul 25 22:56:32 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 22:56:35.429477 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-6a3bc378-576a-4944-8d5b-d20fa257221e admin admin] Calling method '>' {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:56:35.429477 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-6a3bc378-576a-4944-8d5b-d20fa257221e admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.006239 Jul 25 22:56:35.429477 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 16/30] 10.222.0.55 () {54 vars in 930 bytes} [Mon Jul 25 22:56:35 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 22:56:36.158981 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-d1471e25-d02f-4208-acd9-0e5c00284061 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "4", "ram": 8192, "os-flavor-access:is_public": true, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 22:56:36.491816 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-d1471e25-d02f-4208-acd9-0e5c00284061 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 1.094553 Jul 25 22:56:36.492369 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 15/31] 10.222.0.55 () {64 vars in 1282 bytes} [Mon Jul 25 22:56:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 22:56:36.504962 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-ab7e6535-50fe-44e3-bd3e-413d9e4086c9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 22:56:36.642559 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-ab7e6535-50fe-44e3-bd3e-413d9e4086c9 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.140856 Jul 25 22:56:36.657260 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 17/32] 10.222.0.55 () {64 vars in 1332 bytes} [Mon Jul 25 22:56:36 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 22:56:39.722474 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-d1471e25-d02f-4208-acd9-0e5c00284061 admin admin] Calling method '>' {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:56:39.723735 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-d1471e25-d02f-4208-acd9-0e5c00284061 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002614 Jul 25 22:56:39.724255 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 16/33] 10.222.0.55 () {54 vars in 930 bytes} [Mon Jul 25 22:56:39 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 22:56:40.493252 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-7f95c132-0cf2-494d-9d63-773f3c5247f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "disk": 160, "swap": 0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "ram": 16384, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 22:56:40.501603 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG dbcounter [-] [103615] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=103615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:56:40.578310 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-7f95c132-0cf2-494d-9d63-773f3c5247f2 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.846138 Jul 25 22:56:40.578814 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 18/34] 10.222.0.55 () {64 vars in 1282 bytes} [Mon Jul 25 22:56:39 2022] POST /compute/v2.1/flavors => generated 408 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 22:56:40.599827 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-126c5ab1-f0aa-4ede-9872-1c1bde4e32c9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 22:56:40.713930 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-126c5ab1-f0aa-4ede-9872-1c1bde4e32c9 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.116977 Jul 25 22:56:40.718120 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 17/35] 10.222.0.55 () {64 vars in 1332 bytes} [Mon Jul 25 22:56:40 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 22:57:01.611767 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-7f95c132-0cf2-494d-9d63-773f3c5247f2 admin admin] Calling method '>' {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:57:01.612814 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-7f95c132-0cf2-494d-9d63-773f3c5247f2 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jul 25 22:57:01.613250 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 19/36] 10.222.0.55 () {54 vars in 930 bytes} [Mon Jul 25 22:57:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 22:57:01.626308 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG dbcounter [-] [103614] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=103614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:57:02.075626 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-07ed7d67-7f70-4167-be10-2b3b114c0a62 admin admin] Calling method '>' {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:57:02.095413 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-07ed7d67-7f70-4167-be10-2b3b114c0a62 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.474162 Jul 25 22:57:02.095977 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 18/37] 10.222.0.55 () {60 vars in 1291 bytes} [Mon Jul 25 22:57:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 22:57:03.247853 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-7f95c132-0cf2-494d-9d63-773f3c5247f2 admin admin] Calling method '>' {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:57:03.252897 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-7f95c132-0cf2-494d-9d63-773f3c5247f2 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jul 25 22:57:03.253399 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 20/38] 10.222.0.55 () {56 vars in 1074 bytes} [Mon Jul 25 22:57:03 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 22:57:03.833497 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-73091fd8-922f-44ec-a243-7c95d245f278 admin admin] Calling method '>' {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:57:03.839305 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.wsgi [None req-73091fd8-922f-44ec-a243-7c95d245f278 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 25 22:57:03.842690 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-73091fd8-922f-44ec-a243-7c95d245f278 admin admin] Request method failure captured: Jul 25 22:57:03.842690 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 25 22:57:03.842690 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: Accept: application/json Jul 25 22:57:03.842690 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: Accept-Encoding: gzip, deflate Jul 25 22:57:03.842690 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: Connection: keep-alive Jul 25 22:57:03.842690 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: Content-Length: 0 Jul 25 22:57:03.842690 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: Host: 10.222.0.55 Jul 25 22:57:03.842690 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: Openstack-Api-Version: compute 2.90 Jul 25 22:57:03.842690 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: Openstack-System-Scope: None Jul 25 22:57:03.842690 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: User-Agent: python-novaclient Jul 25 22:57:03.842690 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Auth-Token: gAAAAABi3x-_Gb9xSJmMNRSY0emyvG2IbK2HS9EQ-9ZgAgA5HgPK5Di9Y37DobeFNq3BMsKf-gLfwJjLNZ2SYRHzwrdKQzQRQCgBNXLKyLLQsNPBKd9UCr2K3bl3msEsnc0rL_9ENKKv3YCygk3CDkGVMDH3_hwV9UGJFqUZCCyDlQxcJnCMWOY Jul 25 22:57:03.842690 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Domain-Id: None Jul 25 22:57:03.842690 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Domain-Name: None Jul 25 22:57:03.842690 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Identity-Status: Confirmed Jul 25 22:57:03.842690 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Is-Admin-Project: True Jul 25 22:57:03.842690 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 22:57:03.842690 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Project-Domain-Id: default Jul 25 22:57:03.842690 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Project-Domain-Name: Default Jul 25 22:57:03.842690 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Project-Id: 95854b83c1ee4dca86942110e1c80272 Jul 25 22:57:03.842690 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Project-Name: admin Jul 25 22:57:03.842690 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Role: reader,member,admin Jul 25 22:57:03.842690 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Roles: reader,member,admin Jul 25 22:57:03.845604 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/95854b83c1ee4dca86942110e1c80272"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/95854b83c1ee4dca86942110e1c80272"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_95854b83c1ee4dca86942110e1c80272", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/95854b83c1ee4dca86942110e1c80272"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 22:57:03.845604 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Tenant: admin Jul 25 22:57:03.845604 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Tenant-Id: 95854b83c1ee4dca86942110e1c80272 Jul 25 22:57:03.845604 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Tenant-Name: admin Jul 25 22:57:03.845604 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-User: admin Jul 25 22:57:03.845604 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-User-Domain-Id: default Jul 25 22:57:03.845604 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-User-Domain-Name: Default Jul 25 22:57:03.845604 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-User-Id: eb5b24c5d3054270abb8dbb4d3ba574a Jul 25 22:57:03.845604 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-User-Name: admin Jul 25 22:57:03.845604 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: method: > Jul 25 22:57:03.845604 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: exception: Flavor 42 could not be found. Jul 25 22:57:03.845604 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: action_args: {'id': '42'} Jul 25 22:57:03.845604 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 22:57:03.845604 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 22:57:03.847197 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 22:57:03.847197 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 22:57:03.847197 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 22:57:03.847197 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 22:57:03.847197 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 22:57:03.847197 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 22:57:03.847197 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 22:57:03.847197 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 22:57:03.847197 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 22:57:03.847197 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 22:57:03.847197 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 22:57:03.847197 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 22:57:03.847197 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 25 22:57:03.847197 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi Jul 25 22:57:03.847197 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 22:57:03.847197 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi Jul 25 22:57:03.847197 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 22:57:03.847197 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 22:57:03.847197 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 22:57:03.849498 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 22:57:03.849498 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 22:57:03.849498 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 22:57:03.849498 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 22:57:03.849498 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 22:57:03.849498 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 22:57:03.849498 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 25 22:57:03.849498 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi Jul 25 22:57:03.849498 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 22:57:03.849498 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi Jul 25 22:57:03.849498 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 22:57:03.849498 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 22:57:03.849498 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 22:57:03.849498 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 22:57:03.849498 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 22:57:03.849498 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 25 22:57:03.849498 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi Jul 25 22:57:03.849498 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-73091fd8-922f-44ec-a243-7c95d245f278 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 22:57:03.851640 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-73091fd8-922f-44ec-a243-7c95d245f278 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.450112 Jul 25 22:57:03.851640 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 19/39] 10.222.0.55 () {60 vars in 1190 bytes} [Mon Jul 25 22:57:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 451 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:03.855315 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-07f217a0-57c4-4fef-ac9e-03bfd17a669a admin admin] Calling method '>' {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:57:03.878993 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-07f217a0-57c4-4fef-ac9e-03bfd17a669a admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028078 Jul 25 22:57:03.880847 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 21/40] 10.222.0.55 () {60 vars in 1210 bytes} [Mon Jul 25 22:57:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 22:57:03.890153 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-f39c6d73-7f84-4548-9f7f-a2ccbf7e9f0a admin admin] Calling method '>' {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:57:03.916213 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-f39c6d73-7f84-4548-9f7f-a2ccbf7e9f0a admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029698 Jul 25 22:57:03.917437 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 20/41] 10.222.0.55 () {60 vars in 1210 bytes} [Mon Jul 25 22:57:03 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 22:57:03.928121 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-2f4651fc-91d2-485e-9c4e-779ffd7c1e1f admin admin] Calling method '>' {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:57:03.936062 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.wsgi [None req-2f4651fc-91d2-485e-9c4e-779ffd7c1e1f admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 25 22:57:03.939605 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-2f4651fc-91d2-485e-9c4e-779ffd7c1e1f admin admin] Request method failure captured: Jul 25 22:57:03.939605 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 25 22:57:03.939605 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: Accept: application/json Jul 25 22:57:03.939605 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: Accept-Encoding: gzip, deflate Jul 25 22:57:03.939605 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: Connection: keep-alive Jul 25 22:57:03.939605 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: Content-Length: 0 Jul 25 22:57:03.939605 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: Host: 10.222.0.55 Jul 25 22:57:03.939605 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: Openstack-Api-Version: compute 2.90 Jul 25 22:57:03.939605 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: Openstack-System-Scope: None Jul 25 22:57:03.939605 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: User-Agent: python-novaclient Jul 25 22:57:03.939605 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Auth-Token: gAAAAABi3x-_Gb9xSJmMNRSY0emyvG2IbK2HS9EQ-9ZgAgA5HgPK5Di9Y37DobeFNq3BMsKf-gLfwJjLNZ2SYRHzwrdKQzQRQCgBNXLKyLLQsNPBKd9UCr2K3bl3msEsnc0rL_9ENKKv3YCygk3CDkGVMDH3_hwV9UGJFqUZCCyDlQxcJnCMWOY Jul 25 22:57:03.939605 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Domain-Id: None Jul 25 22:57:03.939605 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Domain-Name: None Jul 25 22:57:03.939605 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Identity-Status: Confirmed Jul 25 22:57:03.939605 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Is-Admin-Project: True Jul 25 22:57:03.939605 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 22:57:03.939605 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Project-Domain-Id: default Jul 25 22:57:03.939605 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Project-Domain-Name: Default Jul 25 22:57:03.939605 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Project-Id: 95854b83c1ee4dca86942110e1c80272 Jul 25 22:57:03.939605 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Project-Name: admin Jul 25 22:57:03.939605 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Role: reader,member,admin Jul 25 22:57:03.939605 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Roles: reader,member,admin Jul 25 22:57:03.948293 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/95854b83c1ee4dca86942110e1c80272"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/95854b83c1ee4dca86942110e1c80272"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_95854b83c1ee4dca86942110e1c80272", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/95854b83c1ee4dca86942110e1c80272"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 22:57:03.948293 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Tenant: admin Jul 25 22:57:03.948293 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Tenant-Id: 95854b83c1ee4dca86942110e1c80272 Jul 25 22:57:03.948293 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Tenant-Name: admin Jul 25 22:57:03.948293 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-User: admin Jul 25 22:57:03.948293 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-User-Domain-Id: default Jul 25 22:57:03.948293 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-User-Domain-Name: Default Jul 25 22:57:03.948293 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-User-Id: eb5b24c5d3054270abb8dbb4d3ba574a Jul 25 22:57:03.948293 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-User-Name: admin Jul 25 22:57:03.948293 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: method: > Jul 25 22:57:03.948293 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: exception: Flavor 42 could not be found. Jul 25 22:57:03.948293 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: action_args: {'id': '42'} Jul 25 22:57:03.948293 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 22:57:03.948293 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 22:57:03.949101 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 22:57:03.949101 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 22:57:03.949101 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 22:57:03.949101 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 22:57:03.949101 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 22:57:03.949101 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 22:57:03.949101 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 22:57:03.949101 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 22:57:03.949101 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 22:57:03.949101 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 22:57:03.949101 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 22:57:03.949101 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 22:57:03.949101 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 25 22:57:03.949101 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi Jul 25 22:57:03.949101 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 22:57:03.949101 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi Jul 25 22:57:03.949101 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 22:57:03.949101 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 22:57:03.949101 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 22:57:03.950190 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 22:57:03.950190 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 22:57:03.950190 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 22:57:03.950190 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 22:57:03.950190 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 22:57:03.950190 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 22:57:03.950190 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 25 22:57:03.950190 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi Jul 25 22:57:03.950190 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 22:57:03.950190 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi Jul 25 22:57:03.950190 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 22:57:03.950190 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 22:57:03.950190 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 22:57:03.950190 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 22:57:03.950190 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 22:57:03.950190 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 25 22:57:03.950190 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi Jul 25 22:57:03.950190 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-2f4651fc-91d2-485e-9c4e-779ffd7c1e1f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 22:57:03.951225 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-2f4651fc-91d2-485e-9c4e-779ffd7c1e1f admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.017153 Jul 25 22:57:03.951225 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 22/42] 10.222.0.55 () {60 vars in 1190 bytes} [Mon Jul 25 22:57:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:04.984875 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-f39c6d73-7f84-4548-9f7f-a2ccbf7e9f0a admin admin] Calling method '>' {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:57:04.986775 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-f39c6d73-7f84-4548-9f7f-a2ccbf7e9f0a admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002592 Jul 25 22:57:04.987499 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 21/43] 10.222.0.55 () {56 vars in 1074 bytes} [Mon Jul 25 22:57:04 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 22:57:05.579861 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-9bec5eeb-87f7-46b7-ac41-cef72000b51c admin admin] Calling method '>' {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:57:05.585320 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.wsgi [None req-9bec5eeb-87f7-46b7-ac41-cef72000b51c admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 25 22:57:05.586870 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-9bec5eeb-87f7-46b7-ac41-cef72000b51c admin admin] Request method failure captured: Jul 25 22:57:05.586870 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 25 22:57:05.586870 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: Accept: application/json Jul 25 22:57:05.586870 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: Accept-Encoding: gzip, deflate Jul 25 22:57:05.586870 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: Connection: keep-alive Jul 25 22:57:05.586870 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: Content-Length: 0 Jul 25 22:57:05.586870 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: Host: 10.222.0.55 Jul 25 22:57:05.586870 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: Openstack-Api-Version: compute 2.90 Jul 25 22:57:05.586870 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: Openstack-System-Scope: None Jul 25 22:57:05.586870 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: User-Agent: python-novaclient Jul 25 22:57:05.586870 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Auth-Token: gAAAAABi3x_AfqxJUdafYs2poofzMBq0vVCo8TPGrIL4Le3wUZCvNwiFpC7Aa24zr98sLTGNAf1yXa9lFoqqlWzgO3OP59oF7GIfKbo2ujaX20WOJQEfH9lbKsFFYrVyGz1YGsa9iaCibdX1npkSDH-CGY40oy3g5Qh3mcKRaMcveBDM-ADOEAM Jul 25 22:57:05.586870 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Domain-Id: None Jul 25 22:57:05.586870 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Domain-Name: None Jul 25 22:57:05.586870 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Identity-Status: Confirmed Jul 25 22:57:05.586870 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Is-Admin-Project: True Jul 25 22:57:05.586870 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 22:57:05.586870 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Project-Domain-Id: default Jul 25 22:57:05.586870 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Project-Domain-Name: Default Jul 25 22:57:05.586870 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Project-Id: 95854b83c1ee4dca86942110e1c80272 Jul 25 22:57:05.586870 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Project-Name: admin Jul 25 22:57:05.586870 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Role: reader,member,admin Jul 25 22:57:05.586870 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Roles: reader,member,admin Jul 25 22:57:05.588550 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/95854b83c1ee4dca86942110e1c80272"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/95854b83c1ee4dca86942110e1c80272"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_95854b83c1ee4dca86942110e1c80272", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/95854b83c1ee4dca86942110e1c80272"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 22:57:05.588550 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Tenant: admin Jul 25 22:57:05.588550 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Tenant-Id: 95854b83c1ee4dca86942110e1c80272 Jul 25 22:57:05.588550 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Tenant-Name: admin Jul 25 22:57:05.588550 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-User: admin Jul 25 22:57:05.588550 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-User-Domain-Id: default Jul 25 22:57:05.588550 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-User-Domain-Name: Default Jul 25 22:57:05.588550 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-User-Id: eb5b24c5d3054270abb8dbb4d3ba574a Jul 25 22:57:05.588550 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-User-Name: admin Jul 25 22:57:05.588550 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: method: > Jul 25 22:57:05.588550 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: exception: Flavor 84 could not be found. Jul 25 22:57:05.588550 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: action_args: {'id': '84'} Jul 25 22:57:05.588550 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 22:57:05.588550 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 22:57:05.589457 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 22:57:05.589457 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 22:57:05.589457 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 22:57:05.589457 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 22:57:05.589457 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 22:57:05.589457 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 22:57:05.589457 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 22:57:05.589457 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 22:57:05.589457 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 22:57:05.589457 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 22:57:05.589457 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 22:57:05.589457 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 22:57:05.589457 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 25 22:57:05.589457 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi Jul 25 22:57:05.589457 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 22:57:05.589457 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi Jul 25 22:57:05.589457 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 22:57:05.589457 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 22:57:05.589457 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 22:57:05.590772 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 22:57:05.590772 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 22:57:05.590772 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 22:57:05.590772 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 22:57:05.590772 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 22:57:05.590772 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 22:57:05.590772 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 25 22:57:05.590772 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi Jul 25 22:57:05.590772 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 22:57:05.590772 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi Jul 25 22:57:05.590772 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 22:57:05.590772 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 22:57:05.590772 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 22:57:05.590772 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 22:57:05.590772 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 22:57:05.590772 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 25 22:57:05.590772 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi Jul 25 22:57:05.590772 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-9bec5eeb-87f7-46b7-ac41-cef72000b51c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 22:57:05.591936 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-9bec5eeb-87f7-46b7-ac41-cef72000b51c admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.457652 Jul 25 22:57:05.592148 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 23/44] 10.222.0.55 () {60 vars in 1190 bytes} [Mon Jul 25 22:57:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 462 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:05.599418 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-857cf035-f4ac-4740-b233-0bd5a1f188e3 admin admin] Calling method '>' {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:57:05.615053 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-857cf035-f4ac-4740-b233-0bd5a1f188e3 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019146 Jul 25 22:57:05.615631 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 22/45] 10.222.0.55 () {60 vars in 1210 bytes} [Mon Jul 25 22:57:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 22:57:05.628801 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-22aa6c5f-4c3a-4f6d-9f4a-93dda7a12c6a admin admin] Calling method '>' {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:57:05.647064 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-22aa6c5f-4c3a-4f6d-9f4a-93dda7a12c6a admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021832 Jul 25 22:57:05.647649 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 24/46] 10.222.0.55 () {60 vars in 1210 bytes} [Mon Jul 25 22:57:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 22:57:05.657813 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-9cf467c2-2ad6-4f20-80fd-490c27440e05 admin admin] Calling method '>' {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:57:05.663643 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.wsgi [None req-9cf467c2-2ad6-4f20-80fd-490c27440e05 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 25 22:57:05.665192 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-9cf467c2-2ad6-4f20-80fd-490c27440e05 admin admin] Request method failure captured: Jul 25 22:57:05.665192 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 25 22:57:05.665192 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: Accept: application/json Jul 25 22:57:05.665192 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: Accept-Encoding: gzip, deflate Jul 25 22:57:05.665192 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: Connection: keep-alive Jul 25 22:57:05.665192 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: Content-Length: 0 Jul 25 22:57:05.665192 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: Host: 10.222.0.55 Jul 25 22:57:05.665192 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: Openstack-Api-Version: compute 2.90 Jul 25 22:57:05.665192 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: Openstack-System-Scope: None Jul 25 22:57:05.665192 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: User-Agent: python-novaclient Jul 25 22:57:05.665192 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Auth-Token: gAAAAABi3x_AfqxJUdafYs2poofzMBq0vVCo8TPGrIL4Le3wUZCvNwiFpC7Aa24zr98sLTGNAf1yXa9lFoqqlWzgO3OP59oF7GIfKbo2ujaX20WOJQEfH9lbKsFFYrVyGz1YGsa9iaCibdX1npkSDH-CGY40oy3g5Qh3mcKRaMcveBDM-ADOEAM Jul 25 22:57:05.665192 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Domain-Id: None Jul 25 22:57:05.665192 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Domain-Name: None Jul 25 22:57:05.665192 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Identity-Status: Confirmed Jul 25 22:57:05.665192 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Is-Admin-Project: True Jul 25 22:57:05.665192 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 22:57:05.665192 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Project-Domain-Id: default Jul 25 22:57:05.665192 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Project-Domain-Name: Default Jul 25 22:57:05.665192 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Project-Id: 95854b83c1ee4dca86942110e1c80272 Jul 25 22:57:05.665192 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Project-Name: admin Jul 25 22:57:05.665192 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Role: reader,member,admin Jul 25 22:57:05.665192 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Roles: reader,member,admin Jul 25 22:57:05.666744 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/95854b83c1ee4dca86942110e1c80272"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/95854b83c1ee4dca86942110e1c80272"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_95854b83c1ee4dca86942110e1c80272", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/95854b83c1ee4dca86942110e1c80272"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 22:57:05.666744 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Tenant: admin Jul 25 22:57:05.666744 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Tenant-Id: 95854b83c1ee4dca86942110e1c80272 Jul 25 22:57:05.666744 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Tenant-Name: admin Jul 25 22:57:05.666744 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-User: admin Jul 25 22:57:05.666744 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-User-Domain-Id: default Jul 25 22:57:05.666744 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-User-Domain-Name: Default Jul 25 22:57:05.666744 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-User-Id: eb5b24c5d3054270abb8dbb4d3ba574a Jul 25 22:57:05.666744 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-User-Name: admin Jul 25 22:57:05.666744 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: method: > Jul 25 22:57:05.666744 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: exception: Flavor 84 could not be found. Jul 25 22:57:05.666744 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: action_args: {'id': '84'} Jul 25 22:57:05.666744 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 22:57:05.666744 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 22:57:05.667820 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 22:57:05.667820 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 22:57:05.667820 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 22:57:05.667820 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 22:57:05.667820 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 22:57:05.667820 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 22:57:05.667820 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 22:57:05.667820 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 22:57:05.667820 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 22:57:05.667820 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 22:57:05.667820 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 22:57:05.667820 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 22:57:05.667820 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 25 22:57:05.667820 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi Jul 25 22:57:05.667820 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 22:57:05.667820 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi Jul 25 22:57:05.667820 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 22:57:05.667820 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 22:57:05.667820 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 22:57:05.669203 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 22:57:05.669203 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 22:57:05.669203 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 22:57:05.669203 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 22:57:05.669203 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 22:57:05.669203 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 22:57:05.669203 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 25 22:57:05.669203 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi Jul 25 22:57:05.669203 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 22:57:05.669203 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi Jul 25 22:57:05.669203 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 22:57:05.669203 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 22:57:05.669203 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 22:57:05.669203 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 22:57:05.669203 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 22:57:05.669203 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 25 22:57:05.669203 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi Jul 25 22:57:05.669203 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-9cf467c2-2ad6-4f20-80fd-490c27440e05 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 22:57:05.670212 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-9cf467c2-2ad6-4f20-80fd-490c27440e05 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012441 Jul 25 22:57:05.670212 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 23/47] 10.222.0.55 () {60 vars in 1190 bytes} [Mon Jul 25 22:57:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:06.742919 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-22aa6c5f-4c3a-4f6d-9f4a-93dda7a12c6a admin admin] Calling method '>' {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:57:06.744277 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-22aa6c5f-4c3a-4f6d-9f4a-93dda7a12c6a admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001859 Jul 25 22:57:06.746091 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 25/48] 10.222.0.55 () {56 vars in 1074 bytes} [Mon Jul 25 22:57:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 22:57:07.320583 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-420103fc-ccdd-4081-8886-9f93a6b0a625 admin admin] Calling method '>' {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:57:07.327435 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.wsgi [None req-420103fc-ccdd-4081-8886-9f93a6b0a625 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 25 22:57:07.329006 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-420103fc-ccdd-4081-8886-9f93a6b0a625 admin admin] Request method failure captured: Jul 25 22:57:07.329006 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 25 22:57:07.329006 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: Accept: application/json Jul 25 22:57:07.329006 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: Accept-Encoding: gzip, deflate Jul 25 22:57:07.329006 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: Connection: keep-alive Jul 25 22:57:07.329006 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: Content-Length: 0 Jul 25 22:57:07.329006 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: Host: 10.222.0.55 Jul 25 22:57:07.329006 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: Openstack-Api-Version: compute 2.90 Jul 25 22:57:07.329006 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: Openstack-System-Scope: None Jul 25 22:57:07.329006 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: User-Agent: python-novaclient Jul 25 22:57:07.329006 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Auth-Token: gAAAAABi3x_C2sQriZmXMfJuIYxtTVly9su_tJn6XRMnt80rDMTF80q_nrIvGdyuzWvW_tQsoaR8cH4r2qAEP1pQRM2XH9gFZ9e3OmY96ZfiqpMybPFFM1a4ngvnuQWRQLjjykD4jfX1WAdkII9xMsr35QGEV_gjx5zEyculSCu4A6sSjV65Xeo Jul 25 22:57:07.329006 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Domain-Id: None Jul 25 22:57:07.329006 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Domain-Name: None Jul 25 22:57:07.329006 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Identity-Status: Confirmed Jul 25 22:57:07.329006 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Is-Admin-Project: True Jul 25 22:57:07.329006 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 22:57:07.329006 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Project-Domain-Id: default Jul 25 22:57:07.329006 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Project-Domain-Name: Default Jul 25 22:57:07.329006 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Project-Id: 95854b83c1ee4dca86942110e1c80272 Jul 25 22:57:07.329006 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Project-Name: admin Jul 25 22:57:07.329006 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Role: reader,member,admin Jul 25 22:57:07.329006 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Roles: reader,member,admin Jul 25 22:57:07.330404 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/95854b83c1ee4dca86942110e1c80272"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/95854b83c1ee4dca86942110e1c80272"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_95854b83c1ee4dca86942110e1c80272", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/95854b83c1ee4dca86942110e1c80272"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 22:57:07.330404 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Tenant: admin Jul 25 22:57:07.330404 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Tenant-Id: 95854b83c1ee4dca86942110e1c80272 Jul 25 22:57:07.330404 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-Tenant-Name: admin Jul 25 22:57:07.330404 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-User: admin Jul 25 22:57:07.330404 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-User-Domain-Id: default Jul 25 22:57:07.330404 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-User-Domain-Name: Default Jul 25 22:57:07.330404 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-User-Id: eb5b24c5d3054270abb8dbb4d3ba574a Jul 25 22:57:07.330404 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: X-User-Name: admin Jul 25 22:57:07.330404 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: method: > Jul 25 22:57:07.330404 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: exception: Flavor 451 could not be found. Jul 25 22:57:07.330404 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: action_args: {'id': '451'} Jul 25 22:57:07.330404 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 22:57:07.330404 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 22:57:07.331182 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 22:57:07.331182 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 22:57:07.331182 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 22:57:07.331182 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 22:57:07.331182 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 22:57:07.331182 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 22:57:07.331182 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 22:57:07.331182 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 22:57:07.331182 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 22:57:07.331182 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 22:57:07.331182 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 22:57:07.331182 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 22:57:07.331182 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 25 22:57:07.331182 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi Jul 25 22:57:07.331182 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 22:57:07.331182 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi Jul 25 22:57:07.331182 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 22:57:07.331182 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 22:57:07.331182 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 22:57:07.332329 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 22:57:07.332329 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 22:57:07.332329 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 22:57:07.332329 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 22:57:07.332329 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 22:57:07.332329 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 22:57:07.332329 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 25 22:57:07.332329 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi Jul 25 22:57:07.332329 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 22:57:07.332329 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi Jul 25 22:57:07.332329 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 22:57:07.332329 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 22:57:07.332329 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 22:57:07.332329 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 22:57:07.332329 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 22:57:07.332329 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 25 22:57:07.332329 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: ERROR nova.api.openstack.wsgi Jul 25 22:57:07.332329 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-420103fc-ccdd-4081-8886-9f93a6b0a625 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103614) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 22:57:07.333665 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-420103fc-ccdd-4081-8886-9f93a6b0a625 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.445932 Jul 25 22:57:07.333665 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 24/49] 10.222.0.55 () {60 vars in 1193 bytes} [Mon Jul 25 22:57:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 447 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:07.341262 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-7a839772-a989-4de9-b756-29bfb14405ef admin admin] Calling method '>' {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:57:07.357152 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-7a839772-a989-4de9-b756-29bfb14405ef admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020252 Jul 25 22:57:07.357745 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 26/50] 10.222.0.55 () {60 vars in 1210 bytes} [Mon Jul 25 22:57:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 22:57:07.367560 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-d5531cc9-8977-4be5-a6f5-97e294cea6d6 admin admin] Calling method '>' {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:57:07.386693 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-d5531cc9-8977-4be5-a6f5-97e294cea6d6 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022555 Jul 25 22:57:07.387265 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 25/51] 10.222.0.55 () {60 vars in 1210 bytes} [Mon Jul 25 22:57:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 22:57:07.398563 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-a5a0f733-f495-4060-b233-cee82df54a76 admin admin] Calling method '>' {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:57:07.407523 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.wsgi [None req-a5a0f733-f495-4060-b233-cee82df54a76 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 25 22:57:07.409518 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-a5a0f733-f495-4060-b233-cee82df54a76 admin admin] Request method failure captured: Jul 25 22:57:07.409518 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 25 22:57:07.409518 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: Accept: application/json Jul 25 22:57:07.409518 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: Accept-Encoding: gzip, deflate Jul 25 22:57:07.409518 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: Connection: keep-alive Jul 25 22:57:07.409518 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: Content-Length: 0 Jul 25 22:57:07.409518 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: Host: 10.222.0.55 Jul 25 22:57:07.409518 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: Openstack-Api-Version: compute 2.90 Jul 25 22:57:07.409518 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: Openstack-System-Scope: None Jul 25 22:57:07.409518 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: User-Agent: python-novaclient Jul 25 22:57:07.409518 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Auth-Token: gAAAAABi3x_C2sQriZmXMfJuIYxtTVly9su_tJn6XRMnt80rDMTF80q_nrIvGdyuzWvW_tQsoaR8cH4r2qAEP1pQRM2XH9gFZ9e3OmY96ZfiqpMybPFFM1a4ngvnuQWRQLjjykD4jfX1WAdkII9xMsr35QGEV_gjx5zEyculSCu4A6sSjV65Xeo Jul 25 22:57:07.409518 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Domain-Id: None Jul 25 22:57:07.409518 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Domain-Name: None Jul 25 22:57:07.409518 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Identity-Status: Confirmed Jul 25 22:57:07.409518 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Is-Admin-Project: True Jul 25 22:57:07.409518 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Openstack-Nova-Api-Version: 2.90 Jul 25 22:57:07.409518 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Project-Domain-Id: default Jul 25 22:57:07.409518 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Project-Domain-Name: Default Jul 25 22:57:07.409518 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Project-Id: 95854b83c1ee4dca86942110e1c80272 Jul 25 22:57:07.409518 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Project-Name: admin Jul 25 22:57:07.409518 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Role: reader,member,admin Jul 25 22:57:07.409518 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Roles: reader,member,admin Jul 25 22:57:07.411305 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/95854b83c1ee4dca86942110e1c80272"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/95854b83c1ee4dca86942110e1c80272"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_95854b83c1ee4dca86942110e1c80272", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/95854b83c1ee4dca86942110e1c80272"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 22:57:07.411305 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Tenant: admin Jul 25 22:57:07.411305 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Tenant-Id: 95854b83c1ee4dca86942110e1c80272 Jul 25 22:57:07.411305 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-Tenant-Name: admin Jul 25 22:57:07.411305 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-User: admin Jul 25 22:57:07.411305 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-User-Domain-Id: default Jul 25 22:57:07.411305 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-User-Domain-Name: Default Jul 25 22:57:07.411305 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-User-Id: eb5b24c5d3054270abb8dbb4d3ba574a Jul 25 22:57:07.411305 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: X-User-Name: admin Jul 25 22:57:07.411305 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: method: > Jul 25 22:57:07.411305 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: exception: Flavor 451 could not be found. Jul 25 22:57:07.411305 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: action_args: {'id': '451'} Jul 25 22:57:07.411305 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 22:57:07.411305 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 22:57:07.412267 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 25 22:57:07.412267 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 25 22:57:07.412267 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 25 22:57:07.412267 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 25 22:57:07.412267 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 22:57:07.412267 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 22:57:07.412267 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 25 22:57:07.412267 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 25 22:57:07.412267 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 25 22:57:07.412267 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 22:57:07.412267 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 25 22:57:07.412267 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 25 22:57:07.412267 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 25 22:57:07.412267 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi Jul 25 22:57:07.412267 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 22:57:07.412267 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi Jul 25 22:57:07.412267 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 22:57:07.412267 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 22:57:07.412267 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 22:57:07.413484 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 22:57:07.413484 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 22:57:07.413484 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 22:57:07.413484 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 22:57:07.413484 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 25 22:57:07.413484 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 25 22:57:07.413484 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 25 22:57:07.413484 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi Jul 25 22:57:07.413484 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 22:57:07.413484 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi Jul 25 22:57:07.413484 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 22:57:07.413484 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 22:57:07.413484 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 22:57:07.413484 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 22:57:07.413484 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 22:57:07.413484 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 25 22:57:07.413484 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: ERROR nova.api.openstack.wsgi Jul 25 22:57:07.413484 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-a5a0f733-f495-4060-b233-cee82df54a76 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103615) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 22:57:07.414823 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-a5a0f733-f495-4060-b233-cee82df54a76 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.017740 Jul 25 22:57:07.414823 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 27/52] 10.222.0.55 () {60 vars in 1193 bytes} [Mon Jul 25 22:57:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 25 22:57:08.446219 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-d5531cc9-8977-4be5-a6f5-97e294cea6d6 admin admin] Calling method '>' {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:57:08.447284 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-d5531cc9-8977-4be5-a6f5-97e294cea6d6 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Jul 25 22:57:08.447839 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 26/53] 10.222.0.55 () {56 vars in 1074 bytes} [Mon Jul 25 22:57:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 22:57:09.037209 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-318b596d-893f-48d2-af48-b7e9b9c0c273 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 22:57:09.131319 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-318b596d-893f-48d2-af48-b7e9b9c0c273 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.540238 Jul 25 22:57:09.131790 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 28/54] 10.222.0.55 () {64 vars in 1235 bytes} [Mon Jul 25 22:57:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 22:57:10.145289 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-d5531cc9-8977-4be5-a6f5-97e294cea6d6 admin admin] Calling method '>' {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:57:10.146445 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-d5531cc9-8977-4be5-a6f5-97e294cea6d6 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001614 Jul 25 22:57:10.146842 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 27/55] 10.222.0.55 () {56 vars in 1074 bytes} [Mon Jul 25 22:57:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 22:57:10.709156 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-85e656fc-004f-42af-a14f-32ac3ced8e38 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 22:57:10.782566 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-85e656fc-004f-42af-a14f-32ac3ced8e38 admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.491057 Jul 25 22:57:10.783110 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 29/56] 10.222.0.55 () {64 vars in 1235 bytes} [Mon Jul 25 22:57:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 22:57:11.805521 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-d5531cc9-8977-4be5-a6f5-97e294cea6d6 admin admin] Calling method '>' {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:57:11.806522 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-d5531cc9-8977-4be5-a6f5-97e294cea6d6 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jul 25 22:57:11.807031 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 28/57] 10.222.0.55 () {56 vars in 1074 bytes} [Mon Jul 25 22:57:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 22:57:12.362746 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-dcaa03d5-695f-4f29-bbf3-3892e2d931fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 22:57:12.483647 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-dcaa03d5-695f-4f29-bbf3-3892e2d931fe admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.534889 Jul 25 22:57:12.484203 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 30/58] 10.222.0.55 () {64 vars in 1235 bytes} [Mon Jul 25 22:57:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 22:57:13.512337 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-d5531cc9-8977-4be5-a6f5-97e294cea6d6 admin admin] Calling method '>' {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:57:13.513372 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-d5531cc9-8977-4be5-a6f5-97e294cea6d6 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jul 25 22:57:13.513774 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 29/59] 10.222.0.55 () {56 vars in 1074 bytes} [Mon Jul 25 22:57:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 22:57:14.082415 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-a8ccd573-b352-4623-97b9-103ca9cf5c6f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 22:57:14.154378 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-a8ccd573-b352-4623-97b9-103ca9cf5c6f admin admin] 10.222.0.55 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.501366 Jul 25 22:57:14.154938 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 31/60] 10.222.0.55 () {64 vars in 1235 bytes} [Mon Jul 25 22:57:13 2022] POST /compute/v2.1/flavors => generated 409 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 22:57:15.186602 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-d5531cc9-8977-4be5-a6f5-97e294cea6d6 admin admin] Calling method '>' {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:57:15.187595 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-d5531cc9-8977-4be5-a6f5-97e294cea6d6 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Jul 25 22:57:15.187986 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 30/61] 10.222.0.55 () {56 vars in 1074 bytes} [Mon Jul 25 22:57:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 22:57:15.751953 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-62fe4f66-e0a8-4e76-a76c-caebac04fc7d admin admin] Calling method '>' {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:57:15.774363 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-62fe4f66-e0a8-4e76-a76c-caebac04fc7d admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.442723 Jul 25 22:57:15.774828 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 32/62] 10.222.0.55 () {60 vars in 1202 bytes} [Mon Jul 25 22:57:15 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 22:58:10.254233 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-d5531cc9-8977-4be5-a6f5-97e294cea6d6 admin admin] Calling method '>' {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:58:10.255244 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-d5531cc9-8977-4be5-a6f5-97e294cea6d6 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jul 25 22:58:10.255638 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 31/63] 10.222.0.55 () {54 vars in 930 bytes} [Mon Jul 25 22:58:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 22:58:10.267161 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG dbcounter [-] [103615] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=103615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:58:10.712882 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-0fed851b-7b10-44df-9e6e-6f37ba1123f6 admin admin] Calling method '>' {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:58:10.734615 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-0fed851b-7b10-44df-9e6e-6f37ba1123f6 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.471867 Jul 25 22:58:10.735176 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 33/64] 10.222.0.55 () {60 vars in 1291 bytes} [Mon Jul 25 22:58:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 22:58:10.757106 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG dbcounter [-] [103614] Writing DB stats nova_api:SELECT=14 {{(pid=103614) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 22:58:10.761669 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-0dbd1efd-82dd-48e4-80d9-857e4fc88a96 admin admin] Calling method '>' {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:58:10.770112 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-0dbd1efd-82dd-48e4-80d9-857e4fc88a96 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014479 Jul 25 22:58:10.770592 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 32/65] 10.222.0.55 () {60 vars in 1282 bytes} [Mon Jul 25 22:58:10 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 22:58:10.782925 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-7e61f035-bbc6-432b-ad84-89983d053650 admin admin] Calling method '>' {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:58:10.791495 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-7e61f035-bbc6-432b-ad84-89983d053650 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012243 Jul 25 22:58:10.792055 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 34/66] 10.222.0.55 () {60 vars in 1285 bytes} [Mon Jul 25 22:58:10 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 22:58:10.806967 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-e41e7c66-c68f-4ff7-9830-6648126dbb49 admin admin] Calling method '>' {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:58:10.815862 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-e41e7c66-c68f-4ff7-9830-6648126dbb49 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.015216 Jul 25 22:58:10.816418 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 33/67] 10.222.0.55 () {60 vars in 1285 bytes} [Mon Jul 25 22:58:10 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 22:58:10.829386 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-a3bb6255-4b5e-495d-8191-ac83bf298b29 admin admin] Calling method '>' {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 22:58:10.837986 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-a3bb6255-4b5e-495d-8191-ac83bf298b29 admin admin] 10.222.0.55 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012060 Jul 25 22:58:10.838456 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 35/68] 10.222.0.55 () {60 vars in 1282 bytes} [Mon Jul 25 22:58:10 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:01:50.097580 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-e41e7c66-c68f-4ff7-9830-6648126dbb49 admin admin] Calling method '>' {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:01:50.098601 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-e41e7c66-c68f-4ff7-9830-6648126dbb49 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001586 Jul 25 23:01:50.098981 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 34/69] 10.222.0.55 () {56 vars in 1074 bytes} [Mon Jul 25 23:01:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:01:50.249266 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG dbcounter [-] [103615] Writing DB stats nova_api:SELECT=6 {{(pid=103615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:01:50.404228 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-a93ab59d-583c-41b8-9b97-a1e0120dd0cf admin admin] Calling method '>' {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:01:50.406680 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 23:01:50.406680 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: warnings.warn(msg) Jul 25 23:01:50.407971 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG oslo_concurrency.lockutils [None req-a93ab59d-583c-41b8-9b97-a1e0120dd0cf admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:01:50.408488 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG oslo_concurrency.lockutils [None req-a93ab59d-583c-41b8-9b97-a1e0120dd0cf admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:01:50.409368 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG oslo_concurrency.lockutils [None req-a93ab59d-583c-41b8-9b97-a1e0120dd0cf admin admin] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:01:50.409786 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG oslo_concurrency.lockutils [None req-a93ab59d-583c-41b8-9b97-a1e0120dd0cf admin admin] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:01:50.444555 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-a93ab59d-583c-41b8-9b97-a1e0120dd0cf admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.196115 Jul 25 23:01:50.445365 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 36/70] 10.222.0.55 () {60 vars in 1193 bytes} [Mon Jul 25 23:01:50 2022] GET /compute/v2.1/os-services => generated 794 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 23:01:51.299039 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-e41e7c66-c68f-4ff7-9830-6648126dbb49 admin admin] Calling method '>' {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:01:51.300150 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-e41e7c66-c68f-4ff7-9830-6648126dbb49 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jul 25 23:01:51.300552 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 35/71] 10.222.0.55 () {56 vars in 1074 bytes} [Mon Jul 25 23:01:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:01:51.513825 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-1e3f76e8-465a-4636-9a48-ca844c3086b3 admin admin] Calling method '>' {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:01:51.516300 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 23:01:51.516300 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: warnings.warn(msg) Jul 25 23:01:51.517667 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG oslo_concurrency.lockutils [None req-1e3f76e8-465a-4636-9a48-ca844c3086b3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:01:51.518150 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG oslo_concurrency.lockutils [None req-1e3f76e8-465a-4636-9a48-ca844c3086b3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:01:51.518952 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG oslo_concurrency.lockutils [None req-1e3f76e8-465a-4636-9a48-ca844c3086b3 admin admin] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:01:51.519402 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG oslo_concurrency.lockutils [None req-1e3f76e8-465a-4636-9a48-ca844c3086b3 admin admin] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:01:51.540735 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-1e3f76e8-465a-4636-9a48-ca844c3086b3 admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.092371 Jul 25 23:01:51.541343 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 37/72] 10.222.0.55 () {60 vars in 1193 bytes} [Mon Jul 25 23:01:51 2022] GET /compute/v2.1/os-services => generated 794 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 23:02:02.858195 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-e41e7c66-c68f-4ff7-9830-6648126dbb49 admin admin] Calling method '>' {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:02:02.859588 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-e41e7c66-c68f-4ff7-9830-6648126dbb49 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001895 Jul 25 23:02:02.859937 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 36/73] 10.222.0.55 () {56 vars in 1074 bytes} [Mon Jul 25 23:02:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:02:03.005657 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG dbcounter [-] [103615] Writing DB stats nova_cell0:SELECT=4 {{(pid=103615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:03.006386 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG dbcounter [-] [103615] Writing DB stats nova_cell1:SELECT=4 {{(pid=103615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:03.006996 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG dbcounter [-] [103615] Writing DB stats nova_api:SELECT=8 {{(pid=103615) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:02:03.058819 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-8b78a902-a55a-4ecc-9139-4f2a60372315 admin admin] Calling method '>' {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:02:03.061275 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 23:02:03.061275 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: warnings.warn(msg) Jul 25 23:02:03.062580 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG oslo_concurrency.lockutils [None req-8b78a902-a55a-4ecc-9139-4f2a60372315 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:02:03.067571 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG oslo_concurrency.lockutils [None req-8b78a902-a55a-4ecc-9139-4f2a60372315 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:02:03.067571 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG oslo_concurrency.lockutils [None req-8b78a902-a55a-4ecc-9139-4f2a60372315 admin admin] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:02:03.067571 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG oslo_concurrency.lockutils [None req-8b78a902-a55a-4ecc-9139-4f2a60372315 admin admin] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:02:03.090968 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-8b78a902-a55a-4ecc-9139-4f2a60372315 admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.089652 Jul 25 23:02:03.091550 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 38/74] 10.222.0.55 () {60 vars in 1193 bytes} [Mon Jul 25 23:02:02 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:02:03.961952 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: DEBUG nova.api.openstack.wsgi [None req-e41e7c66-c68f-4ff7-9830-6648126dbb49 admin admin] Calling method '>' {{(pid=103614) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:02:03.962956 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: INFO nova.api.openstack.requestlog [None req-e41e7c66-c68f-4ff7-9830-6648126dbb49 admin admin] 10.222.0.55 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001996 Jul 25 23:02:03.963371 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: [pid: 103614|app: 0|req: 37/75] 10.222.0.55 () {56 vars in 1074 bytes} [Mon Jul 25 23:02:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:02:04.159915 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG nova.api.openstack.wsgi [None req-552a0086-ad9d-4980-8b4c-34c4f918b24c admin admin] Calling method '>' {{(pid=103615) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:02:04.162513 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 23:02:04.162513 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: warnings.warn(msg) Jul 25 23:02:04.163837 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG oslo_concurrency.lockutils [None req-552a0086-ad9d-4980-8b4c-34c4f918b24c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:02:04.164545 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG oslo_concurrency.lockutils [None req-552a0086-ad9d-4980-8b4c-34c4f918b24c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:02:04.165380 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG oslo_concurrency.lockutils [None req-552a0086-ad9d-4980-8b4c-34c4f918b24c admin admin] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:02:04.165871 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: DEBUG oslo_concurrency.lockutils [None req-552a0086-ad9d-4980-8b4c-34c4f918b24c admin admin] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103615) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:02:04.188026 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: INFO nova.api.openstack.requestlog [None req-552a0086-ad9d-4980-8b4c-34c4f918b24c admin admin] 10.222.0.55 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.084621 Jul 25 23:02:04.188589 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: [pid: 103615|app: 0|req: 39/76] 10.222.0.55 () {60 vars in 1193 bytes} [Mon Jul 25 23:02:04 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:02:59.985289 dv-cinder-797608-63-iscsi devstack@n-api.service[103613]: Mon Jul 25 23:02:59 2022 - graceful shutdown triggered... Jul 25 23:02:59.985419 dv-cinder-797608-63-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 25 23:02:59.986621 dv-cinder-797608-63-iscsi devstack@n-api.service[103614]: Gracefully killing worker 1 (pid: 103614)... Jul 25 23:02:59.987056 dv-cinder-797608-63-iscsi devstack@n-api.service[103615]: Gracefully killing worker 2 (pid: 103615)... Jul 25 23:03:00.987754 dv-cinder-797608-63-iscsi devstack@n-api.service[103613]: worker 1 buried after 1 seconds Jul 25 23:03:00.987754 dv-cinder-797608-63-iscsi devstack@n-api.service[103613]: worker 2 buried after 1 seconds Jul 25 23:03:00.987754 dv-cinder-797608-63-iscsi devstack@n-api.service[103613]: goodbye to uWSGI. Jul 25 23:03:00.989562 dv-cinder-797608-63-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 25 23:03:00.990162 dv-cinder-797608-63-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 25 23:03:00.993045 dv-cinder-797608-63-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 25 23:03:01.004067 dv-cinder-797608-63-iscsi devstack@n-api.service[118389]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 25 23:03:01.006203 dv-cinder-797608-63-iscsi devstack@n-api.service[118389]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 23:03:01 2022] *** Jul 25 23:03:01.006203 dv-cinder-797608-63-iscsi devstack@n-api.service[118389]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 23:03:01.006203 dv-cinder-797608-63-iscsi devstack@n-api.service[118389]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 23:03:01.006203 dv-cinder-797608-63-iscsi devstack@n-api.service[118389]: nodename: dv-cinder-797608-63-iscsi Jul 25 23:03:01.006203 dv-cinder-797608-63-iscsi devstack@n-api.service[118389]: machine: x86_64 Jul 25 23:03:01.006203 dv-cinder-797608-63-iscsi devstack@n-api.service[118389]: clock source: unix Jul 25 23:03:01.006203 dv-cinder-797608-63-iscsi devstack@n-api.service[118389]: pcre jit disabled Jul 25 23:03:01.006203 dv-cinder-797608-63-iscsi devstack@n-api.service[118389]: detected number of CPU cores: 4 Jul 25 23:03:01.006203 dv-cinder-797608-63-iscsi devstack@n-api.service[118389]: current working directory: / Jul 25 23:03:01.006203 dv-cinder-797608-63-iscsi devstack@n-api.service[118389]: detected binary path: /usr/bin/uwsgi-core Jul 25 23:03:01.006203 dv-cinder-797608-63-iscsi devstack@n-api.service[118389]: your processes number limit is 47680 Jul 25 23:03:01.007031 dv-cinder-797608-63-iscsi devstack@n-api.service[118389]: your memory page size is 4096 bytes Jul 25 23:03:01.007031 dv-cinder-797608-63-iscsi devstack@n-api.service[118389]: detected max file descriptor number: 2048 Jul 25 23:03:01.007031 dv-cinder-797608-63-iscsi devstack@n-api.service[118389]: lock engine: pthread robust mutexes Jul 25 23:03:01.007031 dv-cinder-797608-63-iscsi devstack@n-api.service[118389]: thunder lock: enabled Jul 25 23:03:01.007031 dv-cinder-797608-63-iscsi devstack@n-api.service[118389]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 25 23:03:01.007031 dv-cinder-797608-63-iscsi devstack@n-api.service[118389]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 23:03:01.050571 dv-cinder-797608-63-iscsi devstack@n-api.service[118389]: Python main interpreter initialized at 0x5568d6a429c0 Jul 25 23:03:01.050571 dv-cinder-797608-63-iscsi devstack@n-api.service[118389]: python threads support enabled Jul 25 23:03:01.050571 dv-cinder-797608-63-iscsi devstack@n-api.service[118389]: your server socket listen backlog is limited to 100 connections Jul 25 23:03:01.050571 dv-cinder-797608-63-iscsi devstack@n-api.service[118389]: your mercy for graceful operations on workers is 90 seconds Jul 25 23:03:01.050571 dv-cinder-797608-63-iscsi devstack@n-api.service[118389]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 23:03:01.050571 dv-cinder-797608-63-iscsi devstack@n-api.service[118389]: *** Operational MODE: preforking *** Jul 25 23:03:01.050571 dv-cinder-797608-63-iscsi devstack@n-api.service[118389]: *** uWSGI is running in multiple interpreter mode *** Jul 25 23:03:01.050571 dv-cinder-797608-63-iscsi devstack@n-api.service[118389]: spawned uWSGI master process (pid: 118389) Jul 25 23:03:01.050571 dv-cinder-797608-63-iscsi devstack@n-api.service[118389]: spawned uWSGI worker 1 (pid: 118409, cores: 1) Jul 25 23:03:01.050571 dv-cinder-797608-63-iscsi devstack@n-api.service[118389]: spawned uWSGI worker 2 (pid: 118410, cores: 1) Jul 25 23:03:01.050571 dv-cinder-797608-63-iscsi devstack@n-api.service[118389]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 23:03:01.048722 dv-cinder-797608-63-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 25 23:03:01.718356 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 23:03:01.756438 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 25 23:03:02.893804 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 23:03:02.893804 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: from cryptography.utils import int_from_bytes Jul 25 23:03:02.899221 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 23:03:02.899221 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: from cryptography.utils import int_from_bytes Jul 25 23:03:02.974773 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 23:03:02.974773 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: from cryptography.utils import int_from_bytes Jul 25 23:03:02.975483 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 23:03:02.975483 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: from cryptography.utils import int_from_bytes Jul 25 23:03:05.334290 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 23:03:05.334837 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 23:03:05.335113 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 23:03:05.335463 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 23:03:05.335720 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 23:03:05.336117 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.336440 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.336941 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.337431 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.337932 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.338400 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.338891 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.339217 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.339550 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.339816 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.340144 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.340468 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-63-iscsi {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.340796 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.341332 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.341663 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.341998 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.342302 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.342629 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.342941 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.343452 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.344977 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.344977 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.344977 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.344977 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.345353 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.345575 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.345815 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.346137 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.346463 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.346777 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.347191 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-63-iscsi {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.347533 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.347826 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.348139 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.348583 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.348887 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.349231 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.349563 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.349891 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.350207 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.350540 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.350866 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.351187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.351519 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.351834 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.352142 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.352446 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.352772 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.353081 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.353422 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.353704 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.353988 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.354314 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.354639 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.354967 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.355226 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.355480 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.355802 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.356126 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.356437 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.356854 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.357261 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.357434 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.357730 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.358092 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.358476 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.358788 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.359112 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.359433 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.359762 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.360074 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.360396 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.360811 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.361065 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.361414 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.361761 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.362085 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.362395 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.362718 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.363041 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.363351 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.363660 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.363970 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.364290 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.364630 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.364939 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.365223 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.365529 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.365836 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.366157 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.366458 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.366769 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.367077 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.367381 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.367690 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.367997 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.368306 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.368613 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.368921 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.369249 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.369561 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.369871 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.370174 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.370505 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.370826 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.371134 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.371439 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.371748 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.372059 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.372381 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.373465 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.373933 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.374244 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.374513 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.374825 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.375149 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.375462 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.375774 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.376096 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.376399 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.376709 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.377030 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.377367 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.377677 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.377980 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.378286 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.378597 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.378901 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.379204 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.379836 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.379836 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.380126 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.380433 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.380742 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.381048 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.381383 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.381702 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.382043 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.382377 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.382725 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.383039 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.383377 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.383710 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.384061 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.384344 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.384664 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.384991 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.385359 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.385687 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.385995 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.386316 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.386636 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.386969 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.387297 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.387611 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.388015 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.388848 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.389195 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.389517 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.389847 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.390162 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.390510 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.390863 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.391176 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.391506 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.391833 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.392150 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.392465 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.392780 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.393106 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.393496 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.393812 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.394134 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.394448 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.394764 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.395077 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.395382 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.395710 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.396058 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.396374 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.396694 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.397009 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.397451 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.397669 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.397981 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.398296 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.398604 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.398912 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.399221 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.399533 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.399839 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.400164 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.400581 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.400875 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.401284 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.401553 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.401817 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.402147 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.402420 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.402731 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.403048 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.403419 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.403744 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.404037 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.404355 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.404801 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.407529 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.407529 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.407529 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.407529 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.407529 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.407529 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.407529 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.407529 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.408695 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.408695 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.408695 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.408695 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.409328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.409328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.409612 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.411242 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.411242 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.411242 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.411242 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.411242 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.412043 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.412043 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.412043 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.412535 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.412695 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.413167 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.413167 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.413494 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.416987 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.416987 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.416987 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.416987 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.416987 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.416987 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.416987 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.416987 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.418312 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.418312 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.418312 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.418312 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.418312 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.418312 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.418312 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.419273 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.419273 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.419273 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.420555 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.420555 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.420555 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.421097 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.421097 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.421499 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.421808 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.422127 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.422471 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.422813 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.423136 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.423461 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.423775 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.424093 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.424405 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.424721 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.425032 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.425372 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.425696 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.426016 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.426339 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.426652 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.426980 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.427295 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.427618 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.427924 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.428239 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.428572 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.428908 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.429243 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.429561 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.429885 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.430199 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.430509 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.430822 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.431128 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.431434 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.431745 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.432077 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.432375 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.432685 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.432992 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.433331 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.433643 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.433950 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.434259 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.434568 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.434891 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.435823 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.436162 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.436493 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.436909 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.437253 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.437583 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.437896 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.438205 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.438511 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.438833 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.439165 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.439478 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.439786 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.440109 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.440434 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.440749 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.441068 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.441415 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.441726 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.442065 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.442369 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.442680 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.442997 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.443108 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 23:03:05.443521 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 23:03:05.443601 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.443695 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.443805 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 23:03:05.443967 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.444300 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.444640 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 23:03:05.445008 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.445222 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 23:03:05.445358 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.445679 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.446045 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.446185 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.446360 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.446685 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.446943 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.447272 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.447581 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.447704 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.447911 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.448164 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.448278 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.448506 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.448627 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.448825 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.448931 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.449185 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.449300 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.449515 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.449611 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.449848 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.449945 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.450111 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.450298 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.450425 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.450578 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.450797 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.451105 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.451210 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-63-iscsi {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.451419 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.451534 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.451836 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.451986 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.452150 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.452462 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.452763 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.452888 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.453073 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.453409 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.453717 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.453825 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.454029 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.454141 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.454350 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.454474 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.454660 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.454767 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.454978 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.455180 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.455302 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.455493 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.455599 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.455805 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.455968 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.456112 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.456269 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.456444 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.456623 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.456779 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.456929 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.457079 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.457284 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.457431 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.457580 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.457741 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.457905 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.458059 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.458210 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.458355 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.458505 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.458660 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-63-iscsi {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.458811 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.458963 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.459114 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.459257 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.459399 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.459556 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.459714 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.459871 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.460026 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.460176 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.460333 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.462892 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.463084 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.463262 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.463423 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.463576 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.464405 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.464585 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.464739 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.464887 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.465035 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.465219 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.465373 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.465531 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.465702 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.465871 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.466101 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.466290 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.466441 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.466650 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.466898 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.467167 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.467401 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.467565 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.467725 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.467889 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.468048 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.468217 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.468375 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.469087 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.469315 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.469476 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.469625 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.469773 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.469931 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.470088 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.470250 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.470408 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.470557 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.470727 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.470879 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.470879 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.471186 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.471344 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.471344 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.471652 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.471858 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.472017 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.472166 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.472313 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.472460 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.472618 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.472774 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.472936 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.473094 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.473265 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.473415 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.473561 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.473720 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.474342 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.474668 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.474826 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.474985 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.475135 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.475303 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.475460 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.475618 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.475766 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.475914 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.476157 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.476329 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.476487 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.476637 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.55 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.476792 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.476951 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.55 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.477141 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.477316 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.477485 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.477643 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.477792 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.477948 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.478104 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.478263 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.478420 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.478569 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.478716 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.478864 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.479024 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.479174 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.479329 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.479496 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.479652 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.479802 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.479963 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.480113 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.480217 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.480291 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.480367 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.480445 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.480541 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.480627 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.480718 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.480801 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.480891 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.480976 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.481059 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.481151 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.481243 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.481328 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.481407 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.481488 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.481566 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.481640 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.482304 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.482394 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.482467 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.482547 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.482673 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.482819 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.482970 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.483119 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.483280 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.483457 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.483538 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.483610 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.483680 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.483751 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.483751 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.483893 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.484486 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.484795 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.484795 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.484795 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.484795 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.484795 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.485209 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.485290 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.485410 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.485504 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.485586 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.485668 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.485746 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.485825 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.485903 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.485974 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.486055 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.486127 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.486300 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.486389 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.486463 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.486540 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.486611 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.486681 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.486758 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.486875 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.486962 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.487033 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.487118 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.487197 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.487274 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.487357 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.487481 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.487561 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.487633 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.487702 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.487780 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.487863 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.487941 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.488011 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.488087 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.488164 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.488243 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.488364 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.488450 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.488530 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.488602 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.488671 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.488753 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.488825 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.488895 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.488972 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.489044 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.489113 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.489225 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.489453 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.489536 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.489767 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.489850 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.490065 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.490155 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.490363 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.490505 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.490677 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.490821 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.490978 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.491134 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.491294 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.491441 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.491591 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.491757 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.491893 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.492070 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.492209 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 23:03:05.492389 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.492547 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.492706 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.492876 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.493014 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.495070 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.495249 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.495404 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.495566 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.495727 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.495887 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.496039 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.496194 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.496436 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.496618 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.496769 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.496925 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.497075 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.497255 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.497436 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.498166 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.498403 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.498638 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.498939 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.499095 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.499240 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.499396 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.499558 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.499701 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.499852 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.499993 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.500256 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.500408 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.500552 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.500694 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.500847 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.501000 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.501196 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.501354 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.501505 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.501505 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.501901 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.502083 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.502240 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.502393 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.502538 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.502688 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.502831 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.502987 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.503131 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.503274 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.503418 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.503580 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.503731 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.503915 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.504089 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.504089 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.504402 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.504402 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.505321 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.505583 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.505743 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.505893 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.506052 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.506211 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.506373 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.506679 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.506861 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.507022 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.507183 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.507382 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.507596 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.507749 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.507905 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.508055 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.508213 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.508364 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.508522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.508699 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.508865 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.509019 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.509187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.509355 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.509520 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.509680 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.509830 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.509987 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.511128 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.511294 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.511761 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.511932 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.512082 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.512314 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.512472 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.513324 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.513594 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.513853 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.514045 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.514214 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.514364 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.514528 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.514679 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.514849 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.515607 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.515777 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.515929 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.516089 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.516345 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.516501 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.516760 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.516922 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.517074 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.517274 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.517426 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.517576 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.517724 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.517892 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.518043 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.518271 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.518431 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.518589 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.518751 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.518908 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.519070 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.519230 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.519389 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.519545 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.519694 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.519843 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.519843 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.520162 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.520323 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.520473 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.520622 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.520771 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.520929 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.521085 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.521263 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.521425 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.521577 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.521738 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.521899 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.522055 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.522213 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.522213 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.522496 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.522654 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.522810 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.522966 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.523116 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.523274 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.523424 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.523581 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.523731 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.523890 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.524046 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.524195 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.524345 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.524502 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.524660 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.524817 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.524965 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.525160 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.525929 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.526104 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.526263 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.526527 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.526696 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.526941 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.527109 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.527260 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.527409 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.527560 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.527716 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.527873 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.528036 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.528187 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.528343 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.528492 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.528714 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.528925 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.529223 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.529515 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.529693 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.529853 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.530012 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.530178 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.530328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.530741 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.530908 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.531059 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.531414 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.531594 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.531747 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.531907 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.532056 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.532212 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.532362 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.532362 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.532658 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.532815 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.532965 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.533137 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.533294 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.533460 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.533629 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.533786 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.533944 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.534094 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.534251 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.534400 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.534557 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.534713 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.534908 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.536800 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.537328 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.537513 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.537666 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.537831 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.537984 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.538133 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.538283 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.538432 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.538590 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.538590 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.538895 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.539046 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.539195 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.540626 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.540838 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.540998 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.541193 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.541362 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.541538 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.541741 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.541923 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.542197 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.542397 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.542553 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.542703 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.542853 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.543012 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.543189 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.543350 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.543501 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.543658 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.543882 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.544048 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.544200 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.544882 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.545042 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.545389 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.546470 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.546648 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.546954 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.547225 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.547395 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.547547 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.547712 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.547712 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.548014 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.548166 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.548315 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.548465 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.548623 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.548781 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.548931 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.549100 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.549271 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.549701 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.549871 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.550036 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.550141 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.550229 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.550321 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.550415 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.550501 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.550585 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.550669 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.550669 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.550840 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.550976 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.551090 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.551206 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.551318 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.551434 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.551559 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.551673 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.551791 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.551919 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.552021 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.552107 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.552204 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.552290 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.552429 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.552518 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.552603 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.552685 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.552783 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.552783 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.552946 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.553029 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.553112 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.553227 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.553313 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.553403 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.553487 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.553577 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.553661 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.553757 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.553757 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.553918 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.554009 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.554099 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.554190 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.554287 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.554372 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.554454 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.554544 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.554635 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.554727 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.554819 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.554912 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.555003 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.555093 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.555183 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.555275 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.555393 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.555497 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.555589 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.555674 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.555774 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.555874 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.555978 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.556373 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.556471 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.556555 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.556647 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.556745 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.556831 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.556915 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.557078 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.557351 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.557448 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.557614 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.557710 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.557796 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.557796 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.557956 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.558050 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.558135 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.558219 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.558307 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.558397 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.558481 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.558572 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.558665 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.558750 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.558833 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.558916 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.558916 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.558916 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.558916 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.559232 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.559315 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.559398 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.559480 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.559575 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.559661 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.559738 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.559809 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.559809 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.560562 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.560674 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.560836 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.560985 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.561169 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.561344 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.561510 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.561605 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.561690 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.561773 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.561868 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.561868 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.562031 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.562117 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.562201 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.562291 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.562382 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.562473 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.562565 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.562657 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.562750 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.562847 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.562941 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.563032 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.563123 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.563214 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.563305 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.563389 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.563481 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.563565 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.563657 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.563754 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.563846 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.563938 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.564084 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.564168 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.564256 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.564352 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.564451 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.564548 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.564633 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.564716 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.564799 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.564896 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.564981 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.565079 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.565192 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.565279 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.565370 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.565370 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.565533 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.565624 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.565714 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.565799 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.565892 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.565977 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.566059 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.566142 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.566405 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.566605 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.566605 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.566778 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.566870 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.566961 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.567052 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.567143 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.567284 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.567485 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.567576 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.567659 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.567743 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.567835 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.567929 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.567929 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.568092 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.568176 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.568269 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.568364 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.568449 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.568539 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.568624 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.568715 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.568807 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.568899 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.568983 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.569077 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.569212 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.569295 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.569386 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.569479 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.569570 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.569662 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.569746 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.569837 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.569928 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.570020 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.570104 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.570187 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.570269 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.570358 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.570518 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.570606 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.570606 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.570754 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.570846 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.570972 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.571070 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.571162 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.571254 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.571351 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.571443 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.571527 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.571623 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.571714 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.571878 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.572020 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.572184 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.572300 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.572389 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.572480 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.572574 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.572647 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.572718 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.572798 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.572871 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.572948 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.573028 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.573099 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.573191 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.573276 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.573494 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.573807 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.574091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.574258 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.574419 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.574598 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.574759 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.574910 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.575060 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.575210 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.575376 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.575556 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.575728 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.575980 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.576243 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.576608 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.576884 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.578649 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.578843 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.578945 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.579036 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.579120 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.579223 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.579313 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.579407 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.579492 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.579577 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.579669 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.579754 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.579838 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.579921 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.580004 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.580094 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.580186 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.580278 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.580368 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.580454 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.580537 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.580628 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.580721 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.580808 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.580897 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.580982 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.581071 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.581181 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.581292 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.581369 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.581439 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.581510 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.581587 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.581673 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.582628 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.582732 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.582816 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.582897 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.582977 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.583065 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.583138 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.583216 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.583309 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.583382 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.583460 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.583555 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.583646 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.583731 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.583890 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.583983 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.584197 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.584303 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.584515 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.584652 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.584825 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.584946 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.585151 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.585275 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.585461 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.585567 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.585765 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.585878 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.586072 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.586169 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.586378 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.586481 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.586685 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.586788 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.587051 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.587170 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.587291 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.587413 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.587590 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.587682 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.587895 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.587998 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.588194 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.588287 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.588496 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.588614 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.588818 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.588957 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.589137 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.589248 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.589452 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.589555 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.589775 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.589868 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.590096 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.590189 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.590413 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.590513 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.590714 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.590805 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.591021 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.591113 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.591358 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.591526 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.591682 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.591852 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.591988 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.592087 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.592254 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.592381 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.592588 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.592681 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.592900 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.592993 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.593243 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.593341 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.593557 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.593663 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.593866 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.593966 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.594173 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.594273 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.594480 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.594581 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.594787 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.594882 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.595090 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.595183 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.595421 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.595513 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.595729 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.595830 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.596032 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.596138 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.596340 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.596432 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.596643 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.596759 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.596953 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.597343 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.597476 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.597584 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.597584 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.597813 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.597907 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.598004 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.598190 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.598312 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.598507 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.598601 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.598900 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.599013 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.599129 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.599240 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.599449 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.599559 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.599765 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.599859 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.600094 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.600185 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.600421 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.600553 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.600731 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.600864 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.601058 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.601196 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.601412 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.601506 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.601766 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.601866 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.602081 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.602187 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.602387 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.602478 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.602708 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.602800 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.603013 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.603119 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.603318 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.603419 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.603618 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.603711 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.603875 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 23:03:05.603976 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.604228 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.604546 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.604969 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.605314 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.605621 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.606039 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.606349 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.606658 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.607564 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.608016 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.608402 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.608651 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.609032 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.609304 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.609630 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.609960 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.610270 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.610586 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.610891 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.611214 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.611692 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.612019 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.612344 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.612767 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.613089 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.613424 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.613744 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.614067 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.614368 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.614672 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.614979 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.615285 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.615594 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.615920 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.616221 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.616536 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.616843 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.617168 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.617563 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.617779 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.618097 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.618399 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.618718 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.619033 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.619449 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.619667 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.619970 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.620287 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.620593 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.620896 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.621220 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.621524 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.621863 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.622171 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.623151 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.623515 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.623845 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.624155 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.624693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.624820 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.625154 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.625471 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.625794 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.626102 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.626401 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.626716 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.627016 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.627317 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.627758 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.627903 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.628204 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.628504 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.628801 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.629137 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.629447 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.629783 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.630069 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.630370 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.630676 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.630972 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.631311 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.631613 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.631946 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.632265 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.632579 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.632904 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.633235 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.633561 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.633873 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.634181 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.634493 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.634806 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.635117 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.635481 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.635739 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.636048 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.636358 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.636668 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.636983 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.637569 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.638006 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.638849 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.639160 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.639480 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.639873 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.640186 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.640490 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.640798 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.641107 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.641433 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.641760 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.642084 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.642406 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.642739 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.643057 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.643369 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.643678 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.643990 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.644346 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.644657 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.644960 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.645293 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.645606 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.645922 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.646234 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.646541 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.646850 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.647166 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.647475 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.647778 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.648091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.648400 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.648716 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.649048 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.649398 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.649710 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.650024 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.650337 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.650864 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.651175 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.651507 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.651881 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.652199 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.652465 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.652779 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.653103 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.653427 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.654428 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.654910 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.655329 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.655902 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.656238 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.656559 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.656859 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.657193 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.657510 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.658253 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.658436 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.658702 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.659028 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.659353 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.659666 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.660039 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.661169 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.661169 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.661169 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.661521 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.661521 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.661799 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.662102 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.662412 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.662725 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.663022 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.663331 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.663629 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.663959 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.664261 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.664568 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.664867 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.665200 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.665506 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.665808 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.666175 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.666419 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.666729 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.667032 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.667347 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.667543 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO dbcounter [None req-586f1255-cfc6-4561-9d66-94f515d88aaf None None] Registered counter for database nova_api Jul 25 23:03:05.667673 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.667940 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.668415 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.668639 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.668907 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.669253 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.669596 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.670065 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.670371 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.670791 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.671115 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.671423 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.671733 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.672082 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.672396 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.672966 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.673319 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.673639 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.674035 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.674302 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.674609 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.674914 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.675220 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.675545 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.675856 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.676164 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.676478 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.676788 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.677096 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.677488 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.677724 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.678032 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.678350 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.678653 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.678959 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.679264 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.679570 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.679883 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.680224 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.680541 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.680855 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.681227 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.681505 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.681812 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.682117 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.682425 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.682798 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.683376 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.683376 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.683665 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.683967 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.684401 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.684709 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.685054 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.685400 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.685711 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.686306 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.686638 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.686947 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.687268 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.687693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.687935 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.688242 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.688567 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.688910 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.689219 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.689535 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.689837 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.690139 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.690458 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.690693 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_db.sqlalchemy.engines [None req-586f1255-cfc6-4561-9d66-94f515d88aaf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 23:03:05.690817 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.691054 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.691365 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.691686 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.691965 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.692269 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.692580 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.692874 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.693193 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.693496 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.693819 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.694099 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.694398 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.694701 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.695012 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.695305 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.695608 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.695911 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.696237 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.696546 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.696847 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.697200 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.697534 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.697851 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.698172 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.698314 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writer thread running {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 23:03:05.698482 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.698802 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.699109 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.699428 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.699749 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.700068 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.700376 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.701257 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.701702 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.702014 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.702324 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.702633 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.702940 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.703249 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.703575 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.703898 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.704203 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.704527 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.704842 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.705179 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.705493 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.705799 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.706126 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.706438 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.706744 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.707051 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.707358 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.707664 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.707975 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.708280 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.708588 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.708897 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.709229 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.709558 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.709881 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.710188 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.710511 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.710834 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.711180 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.711491 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.711832 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.712160 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.712471 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.712778 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.713079 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 23:03:05.713413 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118410) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 23:03:05.756283 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.context [None req-586f1255-cfc6-4561-9d66-94f515d88aaf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),53652832-e111-499c-ae59-8d3f8dfe286d(cell1) {{(pid=118409) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 23:03:05.763659 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-586f1255-cfc6-4561-9d66-94f515d88aaf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:03:05.763659 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-586f1255-cfc6-4561-9d66-94f515d88aaf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:03:05.763659 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-586f1255-cfc6-4561-9d66-94f515d88aaf None None] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:03:05.765686 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-586f1255-cfc6-4561-9d66-94f515d88aaf None None] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:03:05.767769 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO dbcounter [None req-586f1255-cfc6-4561-9d66-94f515d88aaf None None] Registered counter for database nova_cell0 Jul 25 23:03:05.771887 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO dbcounter [None req-586f1255-cfc6-4561-9d66-94f515d88aaf None None] Registered counter for database nova_cell1 Jul 25 23:03:05.775790 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO dbcounter [None req-801ef00b-ab49-4e31-9f65-4c2338995e42 None None] Registered counter for database nova_api Jul 25 23:03:05.780787 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_db.sqlalchemy.engines [None req-586f1255-cfc6-4561-9d66-94f515d88aaf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 23:03:05.781778 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_db.sqlalchemy.engines [None req-586f1255-cfc6-4561-9d66-94f515d88aaf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 23:03:05.790967 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writer thread running {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 23:03:05.793490 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writer thread running {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 23:03:05.797952 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_db.sqlalchemy.engines [None req-801ef00b-ab49-4e31-9f65-4c2338995e42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 23:03:05.804852 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writer thread running {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 23:03:05.861478 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.context [None req-801ef00b-ab49-4e31-9f65-4c2338995e42 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),53652832-e111-499c-ae59-8d3f8dfe286d(cell1) {{(pid=118410) load_cells /opt/stack/nova/nova/context.py:464}} Jul 25 23:03:05.865612 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-801ef00b-ab49-4e31-9f65-4c2338995e42 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:03:05.867204 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-801ef00b-ab49-4e31-9f65-4c2338995e42 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:03:05.867993 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-801ef00b-ab49-4e31-9f65-4c2338995e42 None None] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:03:05.870114 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-801ef00b-ab49-4e31-9f65-4c2338995e42 None None] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:03:05.872091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO dbcounter [None req-801ef00b-ab49-4e31-9f65-4c2338995e42 None None] Registered counter for database nova_cell0 Jul 25 23:03:05.876736 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO dbcounter [None req-801ef00b-ab49-4e31-9f65-4c2338995e42 None None] Registered counter for database nova_cell1 Jul 25 23:03:05.884332 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_db.sqlalchemy.engines [None req-801ef00b-ab49-4e31-9f65-4c2338995e42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 23:03:05.890077 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_db.sqlalchemy.engines [None req-801ef00b-ab49-4e31-9f65-4c2338995e42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 23:03:05.890723 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writer thread running {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 23:03:05.942904 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO dbcounter [None req-586f1255-cfc6-4561-9d66-94f515d88aaf None None] Registered counter for database nova_cell0 Jul 25 23:03:05.949740 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_db.sqlalchemy.engines [None req-586f1255-cfc6-4561-9d66-94f515d88aaf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 23:03:05.955057 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writer thread running {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 23:03:06.036346 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writer thread running {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 23:03:06.048273 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO dbcounter [None req-801ef00b-ab49-4e31-9f65-4c2338995e42 None None] Registered counter for database nova_cell0 Jul 25 23:03:06.055205 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_db.sqlalchemy.engines [None req-801ef00b-ab49-4e31-9f65-4c2338995e42 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118410) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 23:03:06.060629 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writer thread running {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 23:03:06.284011 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: WARNING keystonemiddleware.auth_token [None req-586f1255-cfc6-4561-9d66-94f515d88aaf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 23:03:06.291298 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: WARNING keystonemiddleware.auth_token [None req-586f1255-cfc6-4561-9d66-94f515d88aaf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 23:03:06.383157 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: WARNING keystonemiddleware.auth_token [None req-801ef00b-ab49-4e31-9f65-4c2338995e42 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 23:03:06.391853 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: WARNING keystonemiddleware.auth_token [None req-801ef00b-ab49-4e31-9f65-4c2338995e42 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 23:03:06.641541 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: WARNING keystonemiddleware.auth_token [None req-586f1255-cfc6-4561-9d66-94f515d88aaf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 23:03:06.647830 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: WARNING keystonemiddleware.auth_token [None req-586f1255-cfc6-4561-9d66-94f515d88aaf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 23:03:06.653407 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5568d6a429c0 pid: 118409 (default app) Jul 25 23:03:06.742870 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: WARNING keystonemiddleware.auth_token [None req-801ef00b-ab49-4e31-9f65-4c2338995e42 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 25 23:03:06.749748 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: WARNING keystonemiddleware.auth_token [None req-801ef00b-ab49-4e31-9f65-4c2338995e42 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 25 23:03:06.755088 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5568d6a429c0 pid: 118410 (default app) Jul 25 23:03:47.510120 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_api:SELECT=3 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:47.510983 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=3 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:47.512294 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell0:SELECT=3 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:47.513244 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell0:SELECT=3 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:48.853518 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-18e74424-1e19-48d9-b96d-a8f6829b260b tempest-VolumesNegativeTest-1690517043 tempest-VolumesNegativeTest-1690517043-project] Action: 'create', calling method: .version_select at 0x7f622cf47940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2024800897", "metadata": {"Type": "work"}}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:03:48.857256 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-18e74424-1e19-48d9-b96d-a8f6829b260b tempest-VolumesNegativeTest-1690517043 tempest-VolumesNegativeTest-1690517043-project] Request method failure captured: Jul 25 23:03:48.857256 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 23:03:48.857256 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept: application/json Jul 25 23:03:48.857256 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept-Encoding: identity Jul 25 23:03:48.857256 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Connection: close Jul 25 23:03:48.857256 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Length: 122 Jul 25 23:03:48.857256 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Type: application/json Jul 25 23:03:48.857256 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Host: 10.222.0.55 Jul 25 23:03:48.857256 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Openstack-System-Scope: None Jul 25 23:03:48.857256 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: User-Agent: python-urllib3/1.26.10 Jul 25 23:03:48.857256 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Auth-Token: gAAAAABi3yFT8byp-FoB7TlKAchiZ5szdYqKeJiRPvImqFKfOVxBuUbS9Y8Cm891KR9862eNOcubZFuD9WdSA7Knxo9L9Du-YlaWnnEw3PPs2L4BOxCfRNuWyluPu6-woSchv3VnKdr39gkBZeogdImJAFBHFymyb3S3pmUKs3zrwWLiA4mO_FU Jul 25 23:03:48.857256 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Id: None Jul 25 23:03:48.857256 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Name: None Jul 25 23:03:48.857256 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Identity-Status: Confirmed Jul 25 23:03:48.857256 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Is-Admin-Project: True Jul 25 23:03:48.857256 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Id: default Jul 25 23:03:48.857256 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Name: Default Jul 25 23:03:48.857256 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Id: b5758d6346314cb3bac448b4b052e32c Jul 25 23:03:48.857256 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Name: tempest-VolumesNegativeTest-1690517043 Jul 25 23:03:48.857256 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Role: reader,member Jul 25 23:03:48.857256 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Roles: reader,member Jul 25 23:03:48.858858 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b5758d6346314cb3bac448b4b052e32c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b5758d6346314cb3bac448b4b052e32c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b5758d6346314cb3bac448b4b052e32c", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b5758d6346314cb3bac448b4b052e32c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:03:48.858858 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant: tempest-VolumesNegativeTest-1690517043 Jul 25 23:03:48.858858 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Id: b5758d6346314cb3bac448b4b052e32c Jul 25 23:03:48.858858 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Name: tempest-VolumesNegativeTest-1690517043 Jul 25 23:03:48.858858 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User: tempest-VolumesNegativeTest-1690517043-project Jul 25 23:03:48.858858 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Id: default Jul 25 23:03:48.858858 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Name: Default Jul 25 23:03:48.858858 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Id: a491d60bff954b48ac0d3333ea77643b Jul 25 23:03:48.858858 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Name: tempest-VolumesNegativeTest-1690517043-project Jul 25 23:03:48.858858 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Jul 25 23:03:48.858858 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2024800897", "metadata": {"Type": "work"}}} Jul 25 23:03:48.858858 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: method: Jul 25 23:03:48.858858 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 23:03:48.859803 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2024800897', 'metadata': {'Type': 'work'}}}} Jul 25 23:03:48.859803 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:03:48.859803 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:03:48.859803 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 23:03:48.859803 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 23:03:48.859803 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 23:03:48.859803 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise error Jul 25 23:03:48.859803 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 25 23:03:48.859803 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:03:48.859803 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 25 23:03:48.859803 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 23:03:48.859803 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:03:48.859803 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 23:03:48.859803 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi '#$%' Jul 25 23:03:48.859803 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:03:48.859803 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:03:48.859803 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:03:48.859803 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:03:48.859803 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:03:48.859803 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:03:48.859803 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:03:48.859803 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:03:48.862136 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 23:03:48.862136 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 23:03:48.862136 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:03:48.862136 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:03:48.862136 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 23:03:48.862136 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 23:03:48.862136 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 23:03:48.862136 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 23:03:48.862136 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 23:03:48.862136 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 23:03:48.862136 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 23:03:48.862136 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:03:48.862136 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:03:48.862136 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:03:48.862136 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:03:48.862136 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:03:48.862136 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:03:48.862136 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 23:03:48.862136 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 23:03:48.863522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 25 23:03:48.863522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:03:48.863522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-18e74424-1e19-48d9-b96d-a8f6829b260b tempest-VolumesNegativeTest-1690517043 tempest-VolumesNegativeTest-1690517043-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:03:48.863522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-18e74424-1e19-48d9-b96d-a8f6829b260b tempest-VolumesNegativeTest-1690517043 tempest-VolumesNegativeTest-1690517043-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.359733 Jul 25 23:03:48.863522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 1/1] 10.222.0.55 () {60 vars in 1156 bytes} [Mon Jul 25 23:03:47 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1362 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 23:03:48.873791 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=3 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:48.874897 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=3 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:48.875868 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=3 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:48.876594 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=3 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:03:49.091201 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a80435bb-6565-4715-9314-86eba8567572 tempest-VolumesNegativeTest-1690517043 tempest-VolumesNegativeTest-1690517043-project] Action: 'create', calling method: .version_select at 0x7f622cf1b310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1873785820", "metadata": {"Type": "work"}}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:03:49.096195 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a80435bb-6565-4715-9314-86eba8567572 tempest-VolumesNegativeTest-1690517043 tempest-VolumesNegativeTest-1690517043-project] Request method failure captured: Jul 25 23:03:49.096195 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 23:03:49.096195 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 25 23:03:49.096195 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 25 23:03:49.096195 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Connection: close Jul 25 23:03:49.096195 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Length: 120 Jul 25 23:03:49.096195 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 25 23:03:49.096195 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Host: 10.222.0.55 Jul 25 23:03:49.096195 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 25 23:03:49.096195 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.10 Jul 25 23:03:49.096195 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABi3yFT8byp-FoB7TlKAchiZ5szdYqKeJiRPvImqFKfOVxBuUbS9Y8Cm891KR9862eNOcubZFuD9WdSA7Knxo9L9Du-YlaWnnEw3PPs2L4BOxCfRNuWyluPu6-woSchv3VnKdr39gkBZeogdImJAFBHFymyb3S3pmUKs3zrwWLiA4mO_FU Jul 25 23:03:49.096195 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 25 23:03:49.096195 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 25 23:03:49.096195 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 25 23:03:49.096195 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 25 23:03:49.096195 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 25 23:03:49.096195 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 25 23:03:49.096195 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Id: b5758d6346314cb3bac448b4b052e32c Jul 25 23:03:49.096195 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-VolumesNegativeTest-1690517043 Jul 25 23:03:49.096195 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Role: reader,member Jul 25 23:03:49.096195 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Roles: reader,member Jul 25 23:03:49.097721 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b5758d6346314cb3bac448b4b052e32c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b5758d6346314cb3bac448b4b052e32c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b5758d6346314cb3bac448b4b052e32c", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b5758d6346314cb3bac448b4b052e32c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:03:49.097721 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-VolumesNegativeTest-1690517043 Jul 25 23:03:49.097721 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Id: b5758d6346314cb3bac448b4b052e32c Jul 25 23:03:49.097721 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-VolumesNegativeTest-1690517043 Jul 25 23:03:49.097721 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User: tempest-VolumesNegativeTest-1690517043-project Jul 25 23:03:49.097721 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 25 23:03:49.097721 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 25 23:03:49.097721 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Id: a491d60bff954b48ac0d3333ea77643b Jul 25 23:03:49.097721 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-VolumesNegativeTest-1690517043-project Jul 25 23:03:49.097721 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Jul 25 23:03:49.097721 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1873785820", "metadata": {"Type": "work"}}} Jul 25 23:03:49.097721 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: method: Jul 25 23:03:49.097721 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 23:03:49.098693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1873785820', 'metadata': {'Type': 'work'}}}} Jul 25 23:03:49.098693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:03:49.098693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:03:49.098693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 23:03:49.098693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 23:03:49.098693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 23:03:49.098693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise error Jul 25 23:03:49.098693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 25 23:03:49.098693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:03:49.098693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 25 23:03:49.098693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 23:03:49.098693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:03:49.098693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 23:03:49.098693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi '0' Jul 25 23:03:49.098693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:03:49.098693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:03:49.098693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:03:49.098693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:03:49.098693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:03:49.098693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:03:49.098693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:03:49.098693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:03:49.100774 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 23:03:49.100774 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 23:03:49.100774 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:03:49.100774 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:03:49.100774 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 23:03:49.100774 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 23:03:49.100774 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 23:03:49.100774 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 23:03:49.100774 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 23:03:49.100774 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 23:03:49.100774 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 23:03:49.100774 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:03:49.100774 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:03:49.100774 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:03:49.100774 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:03:49.100774 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:03:49.100774 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:03:49.100774 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 23:03:49.100774 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 23:03:49.102361 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 25 23:03:49.102361 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:03:49.102361 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a80435bb-6565-4715-9314-86eba8567572 tempest-VolumesNegativeTest-1690517043 tempest-VolumesNegativeTest-1690517043-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:03:49.102361 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a80435bb-6565-4715-9314-86eba8567572 tempest-VolumesNegativeTest-1690517043 tempest-VolumesNegativeTest-1690517043-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.230546 Jul 25 23:03:49.102882 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 1/2] 10.222.0.55 () {60 vars in 1156 bytes} [Mon Jul 25 23:03:48 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 238 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 23:03:49.108733 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-989202b9-cfb4-4e49-b28f-3dd2c90e4f66 tempest-VolumesNegativeTest-1690517043 tempest-VolumesNegativeTest-1690517043-project] Action: 'create', calling method: .version_select at 0x7f622cf479d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-104643904", "metadata": {"Type": "work"}}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:03:49.117300 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-989202b9-cfb4-4e49-b28f-3dd2c90e4f66 tempest-VolumesNegativeTest-1690517043 tempest-VolumesNegativeTest-1690517043-project] Request method failure captured: Jul 25 23:03:49.117300 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 25 23:03:49.117300 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept: application/json Jul 25 23:03:49.117300 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept-Encoding: identity Jul 25 23:03:49.117300 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Connection: close Jul 25 23:03:49.117300 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Length: 118 Jul 25 23:03:49.117300 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Type: application/json Jul 25 23:03:49.117300 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Host: 10.222.0.55 Jul 25 23:03:49.117300 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Openstack-System-Scope: None Jul 25 23:03:49.117300 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: User-Agent: python-urllib3/1.26.10 Jul 25 23:03:49.117300 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Auth-Token: gAAAAABi3yFT8byp-FoB7TlKAchiZ5szdYqKeJiRPvImqFKfOVxBuUbS9Y8Cm891KR9862eNOcubZFuD9WdSA7Knxo9L9Du-YlaWnnEw3PPs2L4BOxCfRNuWyluPu6-woSchv3VnKdr39gkBZeogdImJAFBHFymyb3S3pmUKs3zrwWLiA4mO_FU Jul 25 23:03:49.117300 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Id: None Jul 25 23:03:49.117300 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Name: None Jul 25 23:03:49.117300 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Identity-Status: Confirmed Jul 25 23:03:49.117300 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Is-Admin-Project: True Jul 25 23:03:49.117300 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Id: default Jul 25 23:03:49.117300 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Name: Default Jul 25 23:03:49.117300 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Id: b5758d6346314cb3bac448b4b052e32c Jul 25 23:03:49.117300 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Name: tempest-VolumesNegativeTest-1690517043 Jul 25 23:03:49.117300 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Role: reader,member Jul 25 23:03:49.117300 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Roles: reader,member Jul 25 23:03:49.119231 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b5758d6346314cb3bac448b4b052e32c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b5758d6346314cb3bac448b4b052e32c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b5758d6346314cb3bac448b4b052e32c", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b5758d6346314cb3bac448b4b052e32c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:03:49.119231 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant: tempest-VolumesNegativeTest-1690517043 Jul 25 23:03:49.119231 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Id: b5758d6346314cb3bac448b4b052e32c Jul 25 23:03:49.119231 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Name: tempest-VolumesNegativeTest-1690517043 Jul 25 23:03:49.119231 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User: tempest-VolumesNegativeTest-1690517043-project Jul 25 23:03:49.119231 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Id: default Jul 25 23:03:49.119231 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Name: Default Jul 25 23:03:49.119231 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Id: a491d60bff954b48ac0d3333ea77643b Jul 25 23:03:49.119231 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Name: tempest-VolumesNegativeTest-1690517043-project Jul 25 23:03:49.119231 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Jul 25 23:03:49.119231 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-104643904", "metadata": {"Type": "work"}}} Jul 25 23:03:49.119231 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: method: Jul 25 23:03:49.119231 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 23:03:49.120056 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-104643904', 'metadata': {'Type': 'work'}}}} Jul 25 23:03:49.120056 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:03:49.120056 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:03:49.120056 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 25 23:03:49.120056 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 25 23:03:49.120056 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 25 23:03:49.120056 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise error Jul 25 23:03:49.120056 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 25 23:03:49.120056 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:03:49.120056 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 25 23:03:49.120056 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 25 23:03:49.120056 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:03:49.120056 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 25 23:03:49.120056 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi '' Jul 25 23:03:49.120056 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:03:49.120056 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:03:49.120056 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:03:49.120056 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:03:49.120056 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:03:49.120056 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:03:49.120056 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:03:49.120056 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:03:49.122164 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 23:03:49.122164 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 23:03:49.122164 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:03:49.122164 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:03:49.122164 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 25 23:03:49.122164 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 25 23:03:49.122164 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 25 23:03:49.122164 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 25 23:03:49.122164 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 25 23:03:49.122164 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 25 23:03:49.122164 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 23:03:49.122164 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:03:49.122164 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:03:49.122164 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:03:49.122164 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:03:49.122164 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:03:49.122164 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:03:49.122164 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 25 23:03:49.122164 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 25 23:03:49.123511 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 25 23:03:49.123511 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:03:49.123511 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-989202b9-cfb4-4e49-b28f-3dd2c90e4f66 tempest-VolumesNegativeTest-1690517043 tempest-VolumesNegativeTest-1690517043-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:03:49.123511 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-989202b9-cfb4-4e49-b28f-3dd2c90e4f66 tempest-VolumesNegativeTest-1690517043 tempest-VolumesNegativeTest-1690517043-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009681 Jul 25 23:03:49.123511 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 2/3] 10.222.0.55 () {60 vars in 1156 bytes} [Mon Jul 25 23:03:49 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 23:03:49.130223 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d998a18e-a632-4b2c-b970-fda12c94a747 tempest-VolumesNegativeTest-1690517043 tempest-VolumesNegativeTest-1690517043-project] Calling method '.version_select at 0x7f622cf1bee0>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:03:50.638797 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-84730948-61bc-4964-b89f-54e2d87f6da5 tempest-VolumesGetTestJSON-1398664882 tempest-VolumesGetTestJSON-1398664882-project] Action: 'create', calling method: .version_select at 0x7f622ce01430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-797779316", "metadata": {"Type": "work"}}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:03:51.086456 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-d998a18e-a632-4b2c-b970-fda12c94a747 tempest-VolumesNegativeTest-1690517043 tempest-VolumesNegativeTest-1690517043-project] HTTP exception thrown: Volume tempest-invalid-255722135 could not be found. Jul 25 23:03:51.090827 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d998a18e-a632-4b2c-b970-fda12c94a747 tempest-VolumesNegativeTest-1690517043 tempest-VolumesNegativeTest-1690517043-project] Request method failure captured: Jul 25 23:03:51.090827 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-255722135 HTTP/1.1 Jul 25 23:03:51.090827 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 25 23:03:51.090827 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 25 23:03:51.090827 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Connection: close Jul 25 23:03:51.090827 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 25 23:03:51.090827 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 25 23:03:51.090827 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Host: 10.222.0.55 Jul 25 23:03:51.090827 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 25 23:03:51.090827 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.10 Jul 25 23:03:51.090827 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABi3yFT8byp-FoB7TlKAchiZ5szdYqKeJiRPvImqFKfOVxBuUbS9Y8Cm891KR9862eNOcubZFuD9WdSA7Knxo9L9Du-YlaWnnEw3PPs2L4BOxCfRNuWyluPu6-woSchv3VnKdr39gkBZeogdImJAFBHFymyb3S3pmUKs3zrwWLiA4mO_FU Jul 25 23:03:51.090827 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 25 23:03:51.090827 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 25 23:03:51.090827 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 25 23:03:51.090827 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 25 23:03:51.090827 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 25 23:03:51.090827 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 25 23:03:51.090827 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Id: b5758d6346314cb3bac448b4b052e32c Jul 25 23:03:51.090827 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-VolumesNegativeTest-1690517043 Jul 25 23:03:51.090827 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Role: reader,member Jul 25 23:03:51.090827 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Roles: reader,member Jul 25 23:03:51.099026 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b5758d6346314cb3bac448b4b052e32c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b5758d6346314cb3bac448b4b052e32c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b5758d6346314cb3bac448b4b052e32c", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b5758d6346314cb3bac448b4b052e32c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:03:51.099026 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-VolumesNegativeTest-1690517043 Jul 25 23:03:51.099026 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Id: b5758d6346314cb3bac448b4b052e32c Jul 25 23:03:51.099026 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-VolumesNegativeTest-1690517043 Jul 25 23:03:51.099026 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User: tempest-VolumesNegativeTest-1690517043-project Jul 25 23:03:51.099026 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 25 23:03:51.099026 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 25 23:03:51.099026 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Id: a491d60bff954b48ac0d3333ea77643b Jul 25 23:03:51.099026 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-VolumesNegativeTest-1690517043-project Jul 25 23:03:51.099026 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: method: Jul 25 23:03:51.099026 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: exception: Volume tempest-invalid-255722135 could not be found. Jul 25 23:03:51.099026 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: action_args: {'id': 'tempest-invalid-255722135'} Jul 25 23:03:51.099026 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:03:51.099991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:03:51.099991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 23:03:51.099991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 23:03:51.099991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 23:03:51.099991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 23:03:51.099991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 23:03:51.099991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 23:03:51.099991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 23:03:51.099991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 23:03:51.099991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 23:03:51.099991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 23:03:51.099991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 23:03:51.099991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 23:03:51.099991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 23:03:51.099991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 23:03:51.099991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-255722135 could not be found. (HTTP 404) (Request-ID: req-9586876b-cae3-4757-bde2-a3083fec5481) Jul 25 23:03:51.099991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:03:51.099991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:03:51.099991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:03:51.103325 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:03:51.103325 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 23:03:51.103325 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 23:03:51.103325 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 23:03:51.103325 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 23:03:51.103325 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 23:03:51.103325 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 23:03:51.103325 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 23:03:51.103325 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 23:03:51.103325 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 23:03:51.103325 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 23:03:51.103325 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 23:03:51.103325 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 23:03:51.103325 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 23:03:51.103325 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 23:03:51.103325 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 23:03:51.103325 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 23:03:51.103325 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 23:03:51.103325 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 23:03:51.104548 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 23:03:51.104548 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 23:03:51.104548 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 23:03:51.104548 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 23:03:51.104548 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-255722135 could not be found. Jul 25 23:03:51.104548 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:03:51.104548 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:03:51.104548 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:03:51.104548 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:03:51.104548 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:03:51.104548 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:03:51.104548 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:03:51.104548 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:03:51.104548 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 23:03:51.104548 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 23:03:51.104548 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:03:51.104548 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:03:51.104548 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 23:03:51.104548 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:03:51.104548 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-255722135 could not be found. Jul 25 23:03:51.110956 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:03:51.110956 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:03:51.110956 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:03:51.110956 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:03:51.110956 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:03:51.110956 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:03:51.110956 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:03:51.110956 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:03:51.110956 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-255722135 could not be found. Jul 25 23:03:51.110956 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:03:51.110956 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d998a18e-a632-4b2c-b970-fda12c94a747 tempest-VolumesNegativeTest-1690517043 tempest-VolumesNegativeTest-1690517043-project] Returning 404 to user: Volume tempest-invalid-255722135 could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:03:51.110956 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-d998a18e-a632-4b2c-b970-fda12c94a747 tempest-VolumesNegativeTest-1690517043 tempest-VolumesNegativeTest-1690517043-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/tempest-invalid-255722135" status: 404 len: 98 microversion: 2.1 time: 1.966399 Jul 25 23:03:51.110956 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 2/4] 10.222.0.55 () {58 vars in 1215 bytes} [Mon Jul 25 23:03:49 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-255722135 => generated 98 bytes in 1968 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 25 23:03:51.111905 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6668d7cc-bdf5-4a2b-b864-28d409b9f440 tempest-VolumesNegativeTest-1690517043 tempest-VolumesNegativeTest-1690517043-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005043 Jul 25 23:03:51.111905 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 3/5] 10.222.0.55 () {58 vars in 1140 bytes} [Mon Jul 25 23:03:51 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 25 23:03:51.119090 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-7587b0fd-2026-4388-a305-97a2169380f2 tempest-VolumesNegativeTest-1690517043 tempest-VolumesNegativeTest-1690517043-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004294 Jul 25 23:03:51.128972 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 4/6] 10.222.0.55 () {58 vars in 1137 bytes} [Mon Jul 25 23:03:51 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 25 23:03:51.148984 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-301267ea-a6d1-4d45-94f0-8ab6701e8895 tempest-VolumesNegativeTest-1690517043 tempest-VolumesNegativeTest-1690517043-project] Calling method '.version_select at 0x7f622cda8af0>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:03:51.193677 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-301267ea-a6d1-4d45-94f0-8ab6701e8895 tempest-VolumesNegativeTest-1690517043 tempest-VolumesNegativeTest-1690517043-project] HTTP exception thrown: Volume 2de26560-533b-41a3-85a7-30e338b9b0cc could not be found. Jul 25 23:03:51.196919 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-301267ea-a6d1-4d45-94f0-8ab6701e8895 tempest-VolumesNegativeTest-1690517043 tempest-VolumesNegativeTest-1690517043-project] Request method failure captured: Jul 25 23:03:51.196919 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: request: DELETE /compute/v2.1/os-volumes/2de26560-533b-41a3-85a7-30e338b9b0cc HTTP/1.1 Jul 25 23:03:51.196919 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 25 23:03:51.196919 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 25 23:03:51.196919 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Connection: close Jul 25 23:03:51.196919 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 25 23:03:51.196919 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 25 23:03:51.196919 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Host: 10.222.0.55 Jul 25 23:03:51.196919 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 25 23:03:51.196919 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.10 Jul 25 23:03:51.196919 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABi3yFT8byp-FoB7TlKAchiZ5szdYqKeJiRPvImqFKfOVxBuUbS9Y8Cm891KR9862eNOcubZFuD9WdSA7Knxo9L9Du-YlaWnnEw3PPs2L4BOxCfRNuWyluPu6-woSchv3VnKdr39gkBZeogdImJAFBHFymyb3S3pmUKs3zrwWLiA4mO_FU Jul 25 23:03:51.196919 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 25 23:03:51.196919 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 25 23:03:51.196919 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 25 23:03:51.196919 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 25 23:03:51.196919 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 25 23:03:51.196919 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 25 23:03:51.196919 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Id: b5758d6346314cb3bac448b4b052e32c Jul 25 23:03:51.196919 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-VolumesNegativeTest-1690517043 Jul 25 23:03:51.196919 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Role: reader,member Jul 25 23:03:51.196919 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Roles: reader,member Jul 25 23:03:51.198661 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b5758d6346314cb3bac448b4b052e32c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b5758d6346314cb3bac448b4b052e32c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b5758d6346314cb3bac448b4b052e32c", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b5758d6346314cb3bac448b4b052e32c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:03:51.198661 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-VolumesNegativeTest-1690517043 Jul 25 23:03:51.198661 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Id: b5758d6346314cb3bac448b4b052e32c Jul 25 23:03:51.198661 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-VolumesNegativeTest-1690517043 Jul 25 23:03:51.198661 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User: tempest-VolumesNegativeTest-1690517043-project Jul 25 23:03:51.198661 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 25 23:03:51.198661 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 25 23:03:51.198661 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Id: a491d60bff954b48ac0d3333ea77643b Jul 25 23:03:51.198661 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-VolumesNegativeTest-1690517043-project Jul 25 23:03:51.198661 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: method: Jul 25 23:03:51.198661 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: exception: Volume 2de26560-533b-41a3-85a7-30e338b9b0cc could not be found. Jul 25 23:03:51.198661 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: action_args: {'id': '2de26560-533b-41a3-85a7-30e338b9b0cc'} Jul 25 23:03:51.198661 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:03:51.200503 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:03:51.200503 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 23:03:51.200503 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 23:03:51.200503 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 23:03:51.200503 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 23:03:51.200503 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 23:03:51.200503 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 23:03:51.200503 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 23:03:51.200503 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 23:03:51.200503 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 23:03:51.200503 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 23:03:51.200503 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 23:03:51.200503 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 23:03:51.200503 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 23:03:51.200503 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 23:03:51.200503 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2de26560-533b-41a3-85a7-30e338b9b0cc could not be found. (HTTP 404) (Request-ID: req-042a504e-2244-4971-a1a2-2e363364e87e) Jul 25 23:03:51.200503 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:03:51.200503 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:03:51.200503 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:03:51.201712 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:03:51.201712 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 23:03:51.201712 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 23:03:51.201712 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 23:03:51.201712 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 23:03:51.201712 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 23:03:51.201712 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 23:03:51.201712 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 23:03:51.201712 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 23:03:51.201712 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 23:03:51.201712 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 23:03:51.201712 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 23:03:51.201712 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 23:03:51.201712 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 23:03:51.201712 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 23:03:51.201712 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 23:03:51.201712 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 23:03:51.201712 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 23:03:51.201712 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 23:03:51.202841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 23:03:51.202841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 23:03:51.202841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 23:03:51.202841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 23:03:51.202841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2de26560-533b-41a3-85a7-30e338b9b0cc could not be found. Jul 25 23:03:51.202841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:03:51.202841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:03:51.202841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:03:51.202841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:03:51.202841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:03:51.202841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:03:51.202841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:03:51.202841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:03:51.202841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 23:03:51.202841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 23:03:51.202841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:03:51.202841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:03:51.202841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 23:03:51.202841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:03:51.204180 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2de26560-533b-41a3-85a7-30e338b9b0cc could not be found. Jul 25 23:03:51.204180 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:03:51.204180 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:03:51.204180 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:03:51.204180 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:03:51.204180 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:03:51.204180 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:03:51.204180 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:03:51.204180 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:03:51.204180 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2de26560-533b-41a3-85a7-30e338b9b0cc could not be found. Jul 25 23:03:51.204180 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:03:51.204180 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-301267ea-a6d1-4d45-94f0-8ab6701e8895 tempest-VolumesNegativeTest-1690517043 tempest-VolumesNegativeTest-1690517043-project] Returning 404 to user: Volume 2de26560-533b-41a3-85a7-30e338b9b0cc could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:03:51.204180 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-301267ea-a6d1-4d45-94f0-8ab6701e8895 tempest-VolumesNegativeTest-1690517043 tempest-VolumesNegativeTest-1690517043-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/2de26560-533b-41a3-85a7-30e338b9b0cc" status: 404 len: 109 microversion: 2.1 time: 0.058442 Jul 25 23:03:51.204180 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 5/7] 10.222.0.55 () {58 vars in 1248 bytes} [Mon Jul 25 23:03:51 2022] DELETE /compute/v2.1/os-volumes/2de26560-533b-41a3-85a7-30e338b9b0cc => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:03:51.212346 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0f37695d-aec4-43de-be1a-e277d4d67d13 tempest-VolumesNegativeTest-1690517043 tempest-VolumesNegativeTest-1690517043-project] Calling method '.version_select at 0x7f622cd2cd30>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:03:51.259724 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-0f37695d-aec4-43de-be1a-e277d4d67d13 tempest-VolumesNegativeTest-1690517043 tempest-VolumesNegativeTest-1690517043-project] HTTP exception thrown: Volume 8b35bb6c-c7ba-46a3-a3fb-42017d0000be could not be found. Jul 25 23:03:51.262534 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0f37695d-aec4-43de-be1a-e277d4d67d13 tempest-VolumesNegativeTest-1690517043 tempest-VolumesNegativeTest-1690517043-project] Request method failure captured: Jul 25 23:03:51.262534 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/os-volumes/8b35bb6c-c7ba-46a3-a3fb-42017d0000be HTTP/1.1 Jul 25 23:03:51.262534 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 25 23:03:51.262534 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 25 23:03:51.262534 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Connection: close Jul 25 23:03:51.262534 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 25 23:03:51.262534 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 25 23:03:51.262534 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Host: 10.222.0.55 Jul 25 23:03:51.262534 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 25 23:03:51.262534 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.10 Jul 25 23:03:51.262534 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABi3yFT8byp-FoB7TlKAchiZ5szdYqKeJiRPvImqFKfOVxBuUbS9Y8Cm891KR9862eNOcubZFuD9WdSA7Knxo9L9Du-YlaWnnEw3PPs2L4BOxCfRNuWyluPu6-woSchv3VnKdr39gkBZeogdImJAFBHFymyb3S3pmUKs3zrwWLiA4mO_FU Jul 25 23:03:51.262534 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 25 23:03:51.262534 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 25 23:03:51.262534 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 25 23:03:51.262534 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 25 23:03:51.262534 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 25 23:03:51.262534 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 25 23:03:51.262534 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Id: b5758d6346314cb3bac448b4b052e32c Jul 25 23:03:51.262534 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-VolumesNegativeTest-1690517043 Jul 25 23:03:51.262534 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Role: reader,member Jul 25 23:03:51.262534 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Roles: reader,member Jul 25 23:03:51.264299 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b5758d6346314cb3bac448b4b052e32c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/b5758d6346314cb3bac448b4b052e32c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_b5758d6346314cb3bac448b4b052e32c", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/b5758d6346314cb3bac448b4b052e32c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:03:51.264299 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-VolumesNegativeTest-1690517043 Jul 25 23:03:51.264299 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Id: b5758d6346314cb3bac448b4b052e32c Jul 25 23:03:51.264299 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-VolumesNegativeTest-1690517043 Jul 25 23:03:51.264299 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User: tempest-VolumesNegativeTest-1690517043-project Jul 25 23:03:51.264299 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 25 23:03:51.264299 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 25 23:03:51.264299 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Id: a491d60bff954b48ac0d3333ea77643b Jul 25 23:03:51.264299 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-VolumesNegativeTest-1690517043-project Jul 25 23:03:51.264299 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: method: Jul 25 23:03:51.264299 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: exception: Volume 8b35bb6c-c7ba-46a3-a3fb-42017d0000be could not be found. Jul 25 23:03:51.264299 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: action_args: {'id': '8b35bb6c-c7ba-46a3-a3fb-42017d0000be'} Jul 25 23:03:51.264299 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:03:51.265279 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:03:51.265279 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 23:03:51.265279 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 23:03:51.265279 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 23:03:51.265279 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 23:03:51.265279 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 23:03:51.265279 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 23:03:51.265279 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 23:03:51.265279 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 23:03:51.265279 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 23:03:51.265279 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 23:03:51.265279 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 23:03:51.265279 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 23:03:51.265279 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 23:03:51.265279 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 23:03:51.265279 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8b35bb6c-c7ba-46a3-a3fb-42017d0000be could not be found. (HTTP 404) (Request-ID: req-45d9eceb-9d64-4fd1-91c9-e1e7723b6e2a) Jul 25 23:03:51.265279 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:03:51.265279 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:03:51.265279 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:03:51.266731 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:03:51.266731 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 23:03:51.266731 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 23:03:51.266731 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 23:03:51.266731 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 23:03:51.266731 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 23:03:51.266731 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 23:03:51.266731 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 23:03:51.266731 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 23:03:51.266731 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 23:03:51.266731 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 23:03:51.266731 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 23:03:51.266731 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 23:03:51.266731 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 23:03:51.266731 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 23:03:51.266731 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 23:03:51.266731 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 23:03:51.266731 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 23:03:51.266731 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 23:03:51.268091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 23:03:51.268091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 23:03:51.268091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 23:03:51.268091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 23:03:51.268091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8b35bb6c-c7ba-46a3-a3fb-42017d0000be could not be found. Jul 25 23:03:51.268091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:03:51.268091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:03:51.268091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:03:51.268091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:03:51.268091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:03:51.268091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:03:51.268091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:03:51.268091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:03:51.268091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 23:03:51.268091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 23:03:51.268091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:03:51.268091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:03:51.268091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 23:03:51.268091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:03:51.271321 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8b35bb6c-c7ba-46a3-a3fb-42017d0000be could not be found. Jul 25 23:03:51.271321 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:03:51.271321 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:03:51.271321 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:03:51.271321 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:03:51.271321 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:03:51.271321 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:03:51.271321 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:03:51.271321 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:03:51.271321 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8b35bb6c-c7ba-46a3-a3fb-42017d0000be could not be found. Jul 25 23:03:51.271321 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:03:51.271321 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0f37695d-aec4-43de-be1a-e277d4d67d13 tempest-VolumesNegativeTest-1690517043 tempest-VolumesNegativeTest-1690517043-project] Returning 404 to user: Volume 8b35bb6c-c7ba-46a3-a3fb-42017d0000be could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:03:51.271321 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-0f37695d-aec4-43de-be1a-e277d4d67d13 tempest-VolumesNegativeTest-1690517043 tempest-VolumesNegativeTest-1690517043-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/8b35bb6c-c7ba-46a3-a3fb-42017d0000be" status: 404 len: 109 microversion: 2.1 time: 0.057010 Jul 25 23:03:51.276243 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 6/8] 10.222.0.55 () {58 vars in 1245 bytes} [Mon Jul 25 23:03:51 2022] GET /compute/v2.1/os-volumes/8b35bb6c-c7ba-46a3-a3fb-42017d0000be => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:03:53.156270 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-84730948-61bc-4964-b89f-54e2d87f6da5 tempest-VolumesGetTestJSON-1398664882 tempest-VolumesGetTestJSON-1398664882-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.988140 Jul 25 23:03:53.166211 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 3/9] 10.222.0.55 () {60 vars in 1156 bytes} [Mon Jul 25 23:03:50 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2999 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 25 23:03:53.177393 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f92edb42-7a22-42fe-94fb-0e928051e306 tempest-VolumesGetTestJSON-1398664882 tempest-VolumesGetTestJSON-1398664882-project] Calling method '.version_select at 0x7f622cd2c160>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:03:53.409084 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f92edb42-7a22-42fe-94fb-0e928051e306 tempest-VolumesGetTestJSON-1398664882 tempest-VolumesGetTestJSON-1398664882-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/d841bafe-718c-4628-ba33-e9cab0162eef" status: 200 len: 352 microversion: 2.1 time: 0.241528 Jul 25 23:03:53.409725 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 7/10] 10.222.0.55 () {58 vars in 1245 bytes} [Mon Jul 25 23:03:53 2022] GET /compute/v2.1/os-volumes/d841bafe-718c-4628-ba33-e9cab0162eef => generated 352 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:03:54.424322 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-5d0a570f-74e9-4305-8d47-b96e9b93c243 tempest-VolumesGetTestJSON-1398664882 tempest-VolumesGetTestJSON-1398664882-project] Calling method '.version_select at 0x7f622cdd0dc0>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:03:54.537470 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-5d0a570f-74e9-4305-8d47-b96e9b93c243 tempest-VolumesGetTestJSON-1398664882 tempest-VolumesGetTestJSON-1398664882-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/d841bafe-718c-4628-ba33-e9cab0162eef" status: 200 len: 353 microversion: 2.1 time: 0.115006 Jul 25 23:03:54.552812 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 4/11] 10.222.0.55 () {58 vars in 1245 bytes} [Mon Jul 25 23:03:54 2022] GET /compute/v2.1/os-volumes/d841bafe-718c-4628-ba33-e9cab0162eef => generated 353 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:03:54.555345 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-80c515d4-9ed1-4af7-b3f2-498bc2ed8b03 tempest-VolumesGetTestJSON-1398664882 tempest-VolumesGetTestJSON-1398664882-project] Calling method '.version_select at 0x7f622cd7ddc0>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:03:54.675642 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-80c515d4-9ed1-4af7-b3f2-498bc2ed8b03 tempest-VolumesGetTestJSON-1398664882 tempest-VolumesGetTestJSON-1398664882-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/d841bafe-718c-4628-ba33-e9cab0162eef" status: 200 len: 353 microversion: 2.1 time: 0.128582 Jul 25 23:03:54.690684 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 8/12] 10.222.0.55 () {58 vars in 1245 bytes} [Mon Jul 25 23:03:54 2022] GET /compute/v2.1/os-volumes/d841bafe-718c-4628-ba33-e9cab0162eef => generated 353 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:03:54.694232 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-924c41db-5c87-4dde-b478-37e72647a35a tempest-VolumesGetTestJSON-1398664882 tempest-VolumesGetTestJSON-1398664882-project] Calling method '.version_select at 0x7f622cd684c0>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:03:55.422078 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-924c41db-5c87-4dde-b478-37e72647a35a tempest-VolumesGetTestJSON-1398664882 tempest-VolumesGetTestJSON-1398664882-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/d841bafe-718c-4628-ba33-e9cab0162eef" status: 202 len: 0 microversion: 2.1 time: 0.733473 Jul 25 23:03:55.426138 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 5/13] 10.222.0.55 () {58 vars in 1248 bytes} [Mon Jul 25 23:03:54 2022] DELETE /compute/v2.1/os-volumes/d841bafe-718c-4628-ba33-e9cab0162eef => generated 0 bytes in 739 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 23:03:55.439223 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-80241a9b-dce0-4f12-9b85-1923ed4f4ac5 tempest-VolumesGetTestJSON-1398664882 tempest-VolumesGetTestJSON-1398664882-project] Calling method '.version_select at 0x7f622cd3c310>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:03:55.571884 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-80241a9b-dce0-4f12-9b85-1923ed4f4ac5 tempest-VolumesGetTestJSON-1398664882 tempest-VolumesGetTestJSON-1398664882-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/d841bafe-718c-4628-ba33-e9cab0162eef" status: 200 len: 352 microversion: 2.1 time: 0.141273 Jul 25 23:03:55.572497 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 9/14] 10.222.0.55 () {58 vars in 1245 bytes} [Mon Jul 25 23:03:55 2022] GET /compute/v2.1/os-volumes/d841bafe-718c-4628-ba33-e9cab0162eef => generated 352 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:03:56.589883 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-f59b464f-2896-40a2-986b-cbee53180c1d tempest-VolumesGetTestJSON-1398664882 tempest-VolumesGetTestJSON-1398664882-project] Calling method '.version_select at 0x7f622cd68b80>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:03:56.775562 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.wsgi [None req-f59b464f-2896-40a2-986b-cbee53180c1d tempest-VolumesGetTestJSON-1398664882 tempest-VolumesGetTestJSON-1398664882-project] HTTP exception thrown: Volume d841bafe-718c-4628-ba33-e9cab0162eef could not be found. Jul 25 23:03:56.781097 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-f59b464f-2896-40a2-986b-cbee53180c1d tempest-VolumesGetTestJSON-1398664882 tempest-VolumesGetTestJSON-1398664882-project] Request method failure captured: Jul 25 23:03:56.781097 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: request: GET /compute/v2.1/os-volumes/d841bafe-718c-4628-ba33-e9cab0162eef HTTP/1.1 Jul 25 23:03:56.781097 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept: application/json Jul 25 23:03:56.781097 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept-Encoding: identity Jul 25 23:03:56.781097 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Connection: close Jul 25 23:03:56.781097 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Length: 0 Jul 25 23:03:56.781097 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Type: application/json Jul 25 23:03:56.781097 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Host: 10.222.0.55 Jul 25 23:03:56.781097 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Openstack-System-Scope: None Jul 25 23:03:56.781097 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: User-Agent: python-urllib3/1.26.10 Jul 25 23:03:56.781097 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Auth-Token: gAAAAABi3yFWKPYzyYbDE6FzN38_XcMgh52iSxrKQiqPlFsGKceucai0UyZKlFsEHCJeZxszfSMzLAtPc2nGtwO9-jxdGxvV3ZT0iGrdV8eZD50V_I6k6mttAHsDNXVCPiMXALX-SsJFboIORDlZZJIkc_MxjOOE0tK6yFC1ZwMO48CqgF5a27Y Jul 25 23:03:56.781097 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Id: None Jul 25 23:03:56.781097 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Name: None Jul 25 23:03:56.781097 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Identity-Status: Confirmed Jul 25 23:03:56.781097 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Is-Admin-Project: True Jul 25 23:03:56.781097 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Id: default Jul 25 23:03:56.781097 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Name: Default Jul 25 23:03:56.781097 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Id: 5d3254035db24cdd8100a97407aad11b Jul 25 23:03:56.781097 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Name: tempest-VolumesGetTestJSON-1398664882 Jul 25 23:03:56.781097 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Role: reader,member Jul 25 23:03:56.781097 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Roles: reader,member Jul 25 23:03:56.782485 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5d3254035db24cdd8100a97407aad11b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/5d3254035db24cdd8100a97407aad11b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_5d3254035db24cdd8100a97407aad11b", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/5d3254035db24cdd8100a97407aad11b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:03:56.782485 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant: tempest-VolumesGetTestJSON-1398664882 Jul 25 23:03:56.782485 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Id: 5d3254035db24cdd8100a97407aad11b Jul 25 23:03:56.782485 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Name: tempest-VolumesGetTestJSON-1398664882 Jul 25 23:03:56.782485 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User: tempest-VolumesGetTestJSON-1398664882-project Jul 25 23:03:56.782485 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Id: default Jul 25 23:03:56.782485 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Name: Default Jul 25 23:03:56.782485 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Id: a06b78b123714677897220d34d46b5e7 Jul 25 23:03:56.782485 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Name: tempest-VolumesGetTestJSON-1398664882-project Jul 25 23:03:56.782485 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: method: Jul 25 23:03:56.782485 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: exception: Volume d841bafe-718c-4628-ba33-e9cab0162eef could not be found. Jul 25 23:03:56.782485 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: action_args: {'id': 'd841bafe-718c-4628-ba33-e9cab0162eef'} Jul 25 23:03:56.782485 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:03:56.783203 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:03:56.783203 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 23:03:56.783203 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 23:03:56.783203 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 23:03:56.783203 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 23:03:56.783203 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 23:03:56.783203 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 23:03:56.783203 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 23:03:56.783203 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 23:03:56.783203 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 23:03:56.783203 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 23:03:56.783203 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 23:03:56.783203 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 23:03:56.783203 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 23:03:56.783203 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 23:03:56.783203 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d841bafe-718c-4628-ba33-e9cab0162eef could not be found. (HTTP 404) (Request-ID: req-ad2ac3c9-89a9-4cef-bb7b-1f51fdd5fc3f) Jul 25 23:03:56.783203 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:03:56.783203 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:03:56.783203 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:03:56.784441 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:03:56.784441 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 23:03:56.784441 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 23:03:56.784441 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 23:03:56.784441 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 23:03:56.784441 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 23:03:56.784441 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 23:03:56.784441 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 23:03:56.784441 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 23:03:56.784441 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 23:03:56.784441 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 23:03:56.784441 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 23:03:56.784441 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 23:03:56.784441 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 23:03:56.784441 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 23:03:56.784441 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 23:03:56.784441 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 23:03:56.784441 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 23:03:56.784441 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 23:03:56.785869 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 23:03:56.785869 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 23:03:56.785869 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 23:03:56.785869 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 23:03:56.785869 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d841bafe-718c-4628-ba33-e9cab0162eef could not be found. Jul 25 23:03:56.785869 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:03:56.785869 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:03:56.785869 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:03:56.785869 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:03:56.785869 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:03:56.785869 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:03:56.785869 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:03:56.785869 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:03:56.785869 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 23:03:56.785869 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 23:03:56.785869 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:03:56.785869 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:03:56.785869 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 23:03:56.785869 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:03:56.787420 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d841bafe-718c-4628-ba33-e9cab0162eef could not be found. Jul 25 23:03:56.787420 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:03:56.787420 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:03:56.787420 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:03:56.787420 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:03:56.787420 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:03:56.787420 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:03:56.787420 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:03:56.787420 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:03:56.787420 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d841bafe-718c-4628-ba33-e9cab0162eef could not be found. Jul 25 23:03:56.787420 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:03:56.787420 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-f59b464f-2896-40a2-986b-cbee53180c1d tempest-VolumesGetTestJSON-1398664882 tempest-VolumesGetTestJSON-1398664882-project] Returning 404 to user: Volume d841bafe-718c-4628-ba33-e9cab0162eef could not be found. {{(pid=118409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:03:56.791476 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-f59b464f-2896-40a2-986b-cbee53180c1d tempest-VolumesGetTestJSON-1398664882 tempest-VolumesGetTestJSON-1398664882-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/d841bafe-718c-4628-ba33-e9cab0162eef" status: 404 len: 109 microversion: 2.1 time: 0.207087 Jul 25 23:03:56.794031 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 6/15] 10.222.0.55 () {58 vars in 1245 bytes} [Mon Jul 25 23:03:56 2022] GET /compute/v2.1/os-volumes/d841bafe-718c-4628-ba33-e9cab0162eef => generated 109 bytes in 210 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:04:02.303937 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e6f76b55-433f-416d-b61d-b3363bdbaea0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1538171048", "imageRef": "8e9f3265-0fdf-483a-8e2e-41d408f5f0e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:04:02.383108 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-c2ceb29e-e701-40eb-a599-63e4063f37b0 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-851499583", "imageRef": "8e9f3265-0fdf-483a-8e2e-41d408f5f0e7", "flavorRef": "452", "networks": [{"uuid": "6fa065ad-f8f7-4d0c-b979-4f0512cb2e5c"}]}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:04:02.506371 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.network.neutron [None req-e6f76b55-433f-416d-b61d-b3363bdbaea0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] validate_networks() for [('caec5bff-5fb9-4c5c-a304-9aecc48aa721', None, None, None, None, None)] {{(pid=118410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 23:04:02.556748 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.network.neutron [None req-c2ceb29e-e701-40eb-a599-63e4063f37b0 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] validate_networks() for [('6fa065ad-f8f7-4d0c-b979-4f0512cb2e5c', None, None, None, None, None)] {{(pid=118409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 23:04:04.321275 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-c2ceb29e-e701-40eb-a599-63e4063f37b0 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Flavor limits 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 23:04:04.321275 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-c2ceb29e-e701-40eb-a599-63e4063f37b0 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Image limits 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 23:04:04.321275 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-c2ceb29e-e701-40eb-a599-63e4063f37b0 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Flavor pref 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 23:04:04.321275 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-c2ceb29e-e701-40eb-a599-63e4063f37b0 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Image pref 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 23:04:04.321275 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-c2ceb29e-e701-40eb-a599-63e4063f37b0 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 23:04:04.347577 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c2ceb29e-e701-40eb-a599-63e4063f37b0 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:04.354453 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c2ceb29e-e701-40eb-a599-63e4063f37b0 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:04.354453 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c2ceb29e-e701-40eb-a599-63e4063f37b0 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:04.354453 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c2ceb29e-e701-40eb-a599-63e4063f37b0 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:04.444132 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-c2ceb29e-e701-40eb-a599-63e4063f37b0 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Getting quotas for project e3154bd58b544d0d857e5b3918783cc9. Resources: {'instances', 'cores', 'ram'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 23:04:04.480603 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-c2ceb29e-e701-40eb-a599-63e4063f37b0 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Getting quotas for user 20625ee0dcb0427183ad6f9865ff5764 and project e3154bd58b544d0d857e5b3918783cc9. Resources: {'instances', 'cores', 'ram'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 23:04:04.517354 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-c2ceb29e-e701-40eb-a599-63e4063f37b0 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Going to run 1 instances... {{(pid=118409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 23:04:04.517354 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-c2ceb29e-e701-40eb-a599-63e4063f37b0 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e9f3265-0fdf-483a-8e2e-41d408f5f0e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 23:04:04.612488 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-e6f76b55-433f-416d-b61d-b3363bdbaea0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Flavor limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 23:04:04.613069 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-e6f76b55-433f-416d-b61d-b3363bdbaea0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Image limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 23:04:04.613787 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-e6f76b55-433f-416d-b61d-b3363bdbaea0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Flavor pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 23:04:04.614200 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-e6f76b55-433f-416d-b61d-b3363bdbaea0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Image pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 23:04:04.614612 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-e6f76b55-433f-416d-b61d-b3363bdbaea0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 23:04:04.656593 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e6f76b55-433f-416d-b61d-b3363bdbaea0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:04.660122 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e6f76b55-433f-416d-b61d-b3363bdbaea0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:04.663245 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e6f76b55-433f-416d-b61d-b3363bdbaea0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:04.665839 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e6f76b55-433f-416d-b61d-b3363bdbaea0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:04.771049 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-e6f76b55-433f-416d-b61d-b3363bdbaea0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Getting quotas for project d37d3446345749b28d847313e1e6c488. Resources: {'instances', 'cores', 'ram'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 23:04:04.782283 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-e6f76b55-433f-416d-b61d-b3363bdbaea0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Getting quotas for user 61d3b5a3082a4c74a2a08007581388c0 and project d37d3446345749b28d847313e1e6c488. Resources: {'instances', 'cores', 'ram'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 23:04:04.796918 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-c2ceb29e-e701-40eb-a599-63e4063f37b0 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.662443 Jul 25 23:04:04.797601 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 7/16] 10.222.0.55 () {60 vars in 1147 bytes} [Mon Jul 25 23:04:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 23:04:04.810868 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-ec54ea24-a86e-436a-9048-d7e1563956ca tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:04.811496 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-ec54ea24-a86e-436a-9048-d7e1563956ca tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:04.836171 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e6f76b55-433f-416d-b61d-b3363bdbaea0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Going to run 1 instances... {{(pid=118410) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 23:04:04.848090 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e6f76b55-433f-416d-b61d-b3363bdbaea0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e9f3265-0fdf-483a-8e2e-41d408f5f0e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 23:04:05.058680 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-ec54ea24-a86e-436a-9048-d7e1563956ca tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:05.078811 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-ec54ea24-a86e-436a-9048-d7e1563956ca tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1214 microversion: 2.1 time: 0.272342 Jul 25 23:04:05.080154 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 8/17] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:04 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1214 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:05.227091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e6f76b55-433f-416d-b61d-b3363bdbaea0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.368221 Jul 25 23:04:05.227870 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 10/18] 10.222.0.55 () {60 vars in 1147 bytes} [Mon Jul 25 23:04:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 3370 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 23:04:05.248601 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-431d93eb-f752-41d0-a535-4d4fdcd83cd4 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:05.251155 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-431d93eb-f752-41d0-a535-4d4fdcd83cd4 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:05.458138 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-431d93eb-f752-41d0-a535-4d4fdcd83cd4 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:05.472742 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-431d93eb-f752-41d0-a535-4d4fdcd83cd4 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1222 microversion: 2.1 time: 0.233243 Jul 25 23:04:05.479094 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 9/19] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:05 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1222 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:05.617641 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f5af3233-9eb2-4bde-8017-95c71bba126b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-381930358", "imageRef": "8e9f3265-0fdf-483a-8e2e-41d408f5f0e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:04:05.799678 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.network.neutron [None req-f5af3233-9eb2-4bde-8017-95c71bba126b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] validate_networks() for [('caec5bff-5fb9-4c5c-a304-9aecc48aa721', None, None, None, None, None)] {{(pid=118410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 23:04:06.100617 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-73af5a90-5439-447a-b00d-6547f840154c tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:06.101437 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-73af5a90-5439-447a-b00d-6547f840154c tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:06.297436 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-73af5a90-5439-447a-b00d-6547f840154c tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:06.319168 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-73af5a90-5439-447a-b00d-6547f840154c tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1214 microversion: 2.1 time: 0.222695 Jul 25 23:04:06.322891 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 10/20] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:06 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1214 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:04:06.674100 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-f5af3233-9eb2-4bde-8017-95c71bba126b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Flavor limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 23:04:06.674616 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-f5af3233-9eb2-4bde-8017-95c71bba126b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Image limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 23:04:06.675037 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-f5af3233-9eb2-4bde-8017-95c71bba126b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Flavor pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 23:04:06.677766 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-f5af3233-9eb2-4bde-8017-95c71bba126b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Image pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 23:04:06.683542 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-f5af3233-9eb2-4bde-8017-95c71bba126b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 23:04:06.697777 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f5af3233-9eb2-4bde-8017-95c71bba126b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:06.698957 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f5af3233-9eb2-4bde-8017-95c71bba126b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:06.699951 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f5af3233-9eb2-4bde-8017-95c71bba126b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:06.700545 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f5af3233-9eb2-4bde-8017-95c71bba126b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:06.731577 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-f5af3233-9eb2-4bde-8017-95c71bba126b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Getting quotas for project d37d3446345749b28d847313e1e6c488. Resources: {'instances', 'cores', 'ram'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 23:04:06.736813 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-f5af3233-9eb2-4bde-8017-95c71bba126b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Getting quotas for user 61d3b5a3082a4c74a2a08007581388c0 and project d37d3446345749b28d847313e1e6c488. Resources: {'instances', 'cores', 'ram'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 23:04:06.760514 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f5af3233-9eb2-4bde-8017-95c71bba126b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Going to run 1 instances... {{(pid=118410) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 23:04:06.764104 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f5af3233-9eb2-4bde-8017-95c71bba126b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e9f3265-0fdf-483a-8e2e-41d408f5f0e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 23:04:07.000642 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f5af3233-9eb2-4bde-8017-95c71bba126b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.382742 Jul 25 23:04:07.003276 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 11/21] 10.222.0.55 () {60 vars in 1147 bytes} [Mon Jul 25 23:04:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 1392 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 23:04:07.014390 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-f48268a6-8391-4c85-ab87-27658f9c190d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:07.015006 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-f48268a6-8391-4c85-ab87-27658f9c190d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:07.056361 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-17e4ddae-6a52-434d-bb1e-4bb0c688f9ec tempest-VolumesTestJSON-688254254 tempest-VolumesTestJSON-688254254-project] Calling method '.version_select at 0x7f622c4433a0>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:07.241647 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-f48268a6-8391-4c85-ab87-27658f9c190d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:07.249954 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-f48268a6-8391-4c85-ab87-27658f9c190d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1221 microversion: 2.1 time: 0.239575 Jul 25 23:04:07.258992 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 11/22] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:07 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1221 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:04:07.270630 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-17e4ddae-6a52-434d-bb1e-4bb0c688f9ec tempest-VolumesTestJSON-688254254 tempest-VolumesTestJSON-688254254-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/ab9711df-c703-464e-8487-9207d8fc06bb" status: 200 len: 351 microversion: 2.1 time: 0.219218 Jul 25 23:04:07.272317 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 12/23] 10.222.0.55 () {58 vars in 1245 bytes} [Mon Jul 25 23:04:07 2022] GET /compute/v2.1/os-volumes/ab9711df-c703-464e-8487-9207d8fc06bb => generated 351 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:04:07.348300 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-48606d5f-8f00-4ade-8021-00ab467fe468 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:07.349061 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-48606d5f-8f00-4ade-8021-00ab467fe468 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:07.556884 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-48606d5f-8f00-4ade-8021-00ab467fe468 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:07.582288 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-48606d5f-8f00-4ade-8021-00ab467fe468 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1214 microversion: 2.1 time: 0.235900 Jul 25 23:04:07.584080 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 12/24] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:07 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1214 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:08.291256 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a8c7610f-bbea-490a-98ff-718e61a4f450 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:08.292025 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a8c7610f-bbea-490a-98ff-718e61a4f450 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:08.509802 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a8c7610f-bbea-490a-98ff-718e61a4f450 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:08.585708 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a8c7610f-bbea-490a-98ff-718e61a4f450 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1221 microversion: 2.1 time: 0.296630 Jul 25 23:04:08.587335 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 13/25] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:08 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1221 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:08.603957 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-3f92edc8-63f3-4ce8-8bef-633e82d11a72 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:08.606182 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-3f92edc8-63f3-4ce8-8bef-633e82d11a72 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:08.730351 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-3f92edc8-63f3-4ce8-8bef-633e82d11a72 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:08.750817 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-3f92edc8-63f3-4ce8-8bef-633e82d11a72 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1214 microversion: 2.1 time: 0.150535 Jul 25 23:04:08.751408 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 13/26] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:08 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1214 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:09.210679 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-72434afe-a801-44fe-8e27-b271bda14756 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Action: 'create', calling method: .version_select at 0x7f622c446670>, body: {"keypair": {"name": "tempest-keypair-1999345081", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNWM/HO0pCxDhon4+QM07UcKqHnUuQlmopz7bVOjczp9vhqnqZ3A/vXT0UPK87brrMcYfojaY0qCx40oW7+V3stwKhsKd3oRO/llUw/uELWpsVqApkHIt5kWrtxCZG+sQ=="}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:04:09.265860 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-72434afe-a801-44fe-8e27-b271bda14756 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Getting quotas for project f0c3fc0630dd4083bcc8a9f70af99463. Resources: {'key_pairs'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 23:04:09.281949 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-72434afe-a801-44fe-8e27-b271bda14756 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Getting quotas for user 4eea5a29c87d431299b220e404fd5732 and project f0c3fc0630dd4083bcc8a9f70af99463. Resources: {'key_pairs'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 23:04:09.370760 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-26a30ceb-3579-4e9b-82d9-81d34ccd643f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Action: 'create', calling method: .version_select at 0x7f622c3f1700>, body: {"keypair": {"name": "tempest-keypair-488966017", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgzubUxd8xKt7ZAYJ3gRnz2aFjbmUwysH4fX1OKv3AcqFOlbdOlM9MqUQ5MQmZU1ifuf0DkFBfNP9XivDE/AXfilF2mYHnKkWjB89aDzJEmOr21SnfCMI4qLnWRhmMqhA=="}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:04:09.444702 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-26a30ceb-3579-4e9b-82d9-81d34ccd643f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Getting quotas for project 16a417bb74d445f7b2240ccb27061f05. Resources: {'key_pairs'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 23:04:09.456741 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-26a30ceb-3579-4e9b-82d9-81d34ccd643f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Getting quotas for user fbc4fc1f207c4726b9c05b6b338f0e9c and project 16a417bb74d445f7b2240ccb27061f05. Resources: {'key_pairs'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 23:04:09.517017 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-72434afe-a801-44fe-8e27-b271bda14756 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.600903 Jul 25 23:04:09.527982 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 14/27] 10.222.0.55 () {60 vars in 1159 bytes} [Mon Jul 25 23:04:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:04:09.611114 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d99cef5a-b5cb-486f-8be7-0e5043cb39f3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:09.611983 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-d99cef5a-b5cb-486f-8be7-0e5043cb39f3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:09.630706 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d99cef5a-b5cb-486f-8be7-0e5043cb39f3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:09.636206 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d99cef5a-b5cb-486f-8be7-0e5043cb39f3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:09.636206 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d99cef5a-b5cb-486f-8be7-0e5043cb39f3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:09.636206 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d99cef5a-b5cb-486f-8be7-0e5043cb39f3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:09.681373 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-26a30ceb-3579-4e9b-82d9-81d34ccd643f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.613424 Jul 25 23:04:09.689097 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 14/28] 10.222.0.55 () {62 vars in 1200 bytes} [Mon Jul 25 23:04:09 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 623 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 23:04:09.774209 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-b3c4c3e0-f118-4717-8f9c-b71ddb55b728 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:09.775075 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-b3c4c3e0-f118-4717-8f9c-b71ddb55b728 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:09.818566 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b3c4c3e0-f118-4717-8f9c-b71ddb55b728 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:09.818566 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b3c4c3e0-f118-4717-8f9c-b71ddb55b728 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:09.818566 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b3c4c3e0-f118-4717-8f9c-b71ddb55b728 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:09.818566 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b3c4c3e0-f118-4717-8f9c-b71ddb55b728 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:10.071944 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-d99cef5a-b5cb-486f-8be7-0e5043cb39f3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:10.100172 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-d99cef5a-b5cb-486f-8be7-0e5043cb39f3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1217 microversion: 2.1 time: 0.496196 Jul 25 23:04:10.116204 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 15/29] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:09 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1217 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:10.142001 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-bfa2b85c-ff0f-474b-b573-00f04b1f7537 tempest-VolumesTestJSON-688254254 tempest-VolumesTestJSON-688254254-project] Calling method '.version_select at 0x7f622c3f0670>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:10.223207 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-b3c4c3e0-f118-4717-8f9c-b71ddb55b728 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:10.247502 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-b3c4c3e0-f118-4717-8f9c-b71ddb55b728 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1218 microversion: 2.1 time: 0.478845 Jul 25 23:04:10.253548 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 15/30] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:09 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1218 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:10.354123 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-bfa2b85c-ff0f-474b-b573-00f04b1f7537 tempest-VolumesTestJSON-688254254 tempest-VolumesTestJSON-688254254-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/289ca0eb-5bb2-4d39-ac5a-35d2750746e8" status: 200 len: 351 microversion: 2.1 time: 0.234366 Jul 25 23:04:10.354888 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 16/31] 10.222.0.55 () {58 vars in 1245 bytes} [Mon Jul 25 23:04:10 2022] GET /compute/v2.1/os-volumes/289ca0eb-5bb2-4d39-ac5a-35d2750746e8 => generated 351 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:04:11.134135 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-0617d837-8e7c-4a18-8f3a-0cea018965bb tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:11.134891 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-0617d837-8e7c-4a18-8f3a-0cea018965bb tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:11.150189 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0617d837-8e7c-4a18-8f3a-0cea018965bb tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:11.151961 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0617d837-8e7c-4a18-8f3a-0cea018965bb tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:11.166417 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0617d837-8e7c-4a18-8f3a-0cea018965bb tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:11.167633 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0617d837-8e7c-4a18-8f3a-0cea018965bb tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:11.275168 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c363916d-4117-49f0-9700-c6372e7646eb tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:11.276288 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c363916d-4117-49f0-9700-c6372e7646eb tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:11.311789 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c363916d-4117-49f0-9700-c6372e7646eb tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:11.312756 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c363916d-4117-49f0-9700-c6372e7646eb tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:11.319762 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c363916d-4117-49f0-9700-c6372e7646eb tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:11.320902 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c363916d-4117-49f0-9700-c6372e7646eb tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:11.443390 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-0617d837-8e7c-4a18-8f3a-0cea018965bb tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:11.455807 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-0617d837-8e7c-4a18-8f3a-0cea018965bb tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1273 microversion: 2.1 time: 0.328082 Jul 25 23:04:11.457258 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 16/32] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:11 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1273 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:11.508134 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c363916d-4117-49f0-9700-c6372e7646eb tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:11.522202 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c363916d-4117-49f0-9700-c6372e7646eb tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1266 microversion: 2.1 time: 0.253252 Jul 25 23:04:11.522808 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 17/33] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:11 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:12.482966 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-98ab52d4-7df7-4e1e-9505-f04cbdd7e1eb tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:12.483964 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-98ab52d4-7df7-4e1e-9505-f04cbdd7e1eb tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:12.511074 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-98ab52d4-7df7-4e1e-9505-f04cbdd7e1eb tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:12.511789 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-98ab52d4-7df7-4e1e-9505-f04cbdd7e1eb tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:12.523080 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-98ab52d4-7df7-4e1e-9505-f04cbdd7e1eb tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:12.523548 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-98ab52d4-7df7-4e1e-9505-f04cbdd7e1eb tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:12.552947 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-423eef8f-2af9-43ae-b526-b2f90344cef2 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:12.553589 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-423eef8f-2af9-43ae-b526-b2f90344cef2 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:12.575270 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-423eef8f-2af9-43ae-b526-b2f90344cef2 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:12.583306 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-423eef8f-2af9-43ae-b526-b2f90344cef2 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:12.584393 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-423eef8f-2af9-43ae-b526-b2f90344cef2 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:12.585001 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-423eef8f-2af9-43ae-b526-b2f90344cef2 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:12.796403 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-423eef8f-2af9-43ae-b526-b2f90344cef2 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:12.805887 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-423eef8f-2af9-43ae-b526-b2f90344cef2 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1284 microversion: 2.1 time: 0.259983 Jul 25 23:04:12.811412 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 18/34] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:12 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1284 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:12.826850 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-86726770-62c8-4593-9336-f2e19954d3bd tempest-VolumesTestJSON-688254254 tempest-VolumesTestJSON-688254254-project] Calling method '.version_select at 0x7f622c2e2670>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:12.905648 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-98ab52d4-7df7-4e1e-9505-f04cbdd7e1eb tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:12.916219 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-98ab52d4-7df7-4e1e-9505-f04cbdd7e1eb tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1279 microversion: 2.1 time: 0.437842 Jul 25 23:04:12.924680 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 17/35] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:12 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1279 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:12.970665 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-86726770-62c8-4593-9336-f2e19954d3bd tempest-VolumesTestJSON-688254254 tempest-VolumesTestJSON-688254254-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/62cae651-f4ec-4441-9c68-5944d2e99112" status: 200 len: 351 microversion: 2.1 time: 0.148676 Jul 25 23:04:12.970665 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 19/36] 10.222.0.55 () {58 vars in 1245 bytes} [Mon Jul 25 23:04:12 2022] GET /compute/v2.1/os-volumes/62cae651-f4ec-4441-9c68-5944d2e99112 => generated 351 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:04:12.983041 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-bb8533e0-0e8a-4d80-b081-8bc778e890ab tempest-VolumesTestJSON-688254254 tempest-VolumesTestJSON-688254254-project] Calling method '.version_select at 0x7f622c335820>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:13.175875 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-bb8533e0-0e8a-4d80-b081-8bc778e890ab tempest-VolumesTestJSON-688254254 tempest-VolumesTestJSON-688254254-project] 10.222.0.55 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.194094 Jul 25 23:04:13.176882 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 18/37] 10.222.0.55 () {58 vars in 1134 bytes} [Mon Jul 25 23:04:12 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:13.195829 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a0dacc62-c2a4-485c-b760-18c0f487e73d tempest-VolumesTestJSON-688254254 tempest-VolumesTestJSON-688254254-project] Calling method '.version_select at 0x7f622c2e2430>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:13.459660 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a0dacc62-c2a4-485c-b760-18c0f487e73d tempest-VolumesTestJSON-688254254 tempest-VolumesTestJSON-688254254-project] 10.222.0.55 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.271671 Jul 25 23:04:13.460666 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 20/38] 10.222.0.55 () {58 vars in 1149 bytes} [Mon Jul 25 23:04:13 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:04:13.473792 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-b1c3df02-cd3a-4c60-9a14-ce6debe712ed tempest-VolumesTestJSON-688254254 tempest-VolumesTestJSON-688254254-project] Calling method '.version_select at 0x7f622c2e6550>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:13.681816 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-b1c3df02-cd3a-4c60-9a14-ce6debe712ed tempest-VolumesTestJSON-688254254 tempest-VolumesTestJSON-688254254-project] 10.222.0.55 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.211620 Jul 25 23:04:13.685022 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 19/39] 10.222.0.55 () {58 vars in 1134 bytes} [Mon Jul 25 23:04:13 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:13.702521 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-3027b83b-b611-45d2-97e7-89f332f370cb tempest-VolumesTestJSON-688254254 tempest-VolumesTestJSON-688254254-project] Calling method '.version_select at 0x7f622c3f03a0>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:13.833699 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-17e02619-3316-43bd-9167-610de79ba4ac tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:13.834391 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-17e02619-3316-43bd-9167-610de79ba4ac tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:13.853758 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-17e02619-3316-43bd-9167-610de79ba4ac tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:13.857497 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-17e02619-3316-43bd-9167-610de79ba4ac tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:13.857497 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-17e02619-3316-43bd-9167-610de79ba4ac tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:13.857497 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-17e02619-3316-43bd-9167-610de79ba4ac tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:13.927795 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-3027b83b-b611-45d2-97e7-89f332f370cb tempest-VolumesTestJSON-688254254 tempest-VolumesTestJSON-688254254-project] 10.222.0.55 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.230201 Jul 25 23:04:13.928955 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 21/40] 10.222.0.55 () {58 vars in 1167 bytes} [Mon Jul 25 23:04:13 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:04:13.944829 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-7a73e863-de63-4354-84d5-98af30b66f93 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:13.945676 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-7a73e863-de63-4354-84d5-98af30b66f93 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:13.960584 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7a73e863-de63-4354-84d5-98af30b66f93 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:13.963559 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7a73e863-de63-4354-84d5-98af30b66f93 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:13.968850 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7a73e863-de63-4354-84d5-98af30b66f93 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:13.970567 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7a73e863-de63-4354-84d5-98af30b66f93 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:14.070419 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-17e02619-3316-43bd-9167-610de79ba4ac tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:14.081170 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-17e02619-3316-43bd-9167-610de79ba4ac tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1272 microversion: 2.1 time: 0.252684 Jul 25 23:04:14.098740 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 20/41] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:13 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1272 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:14.098740 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-cf68405c-f068-4141-a140-9e1a923e1f06 tempest-VolumesTestJSON-688254254 tempest-VolumesTestJSON-688254254-project] Calling method '.version_select at 0x7f622c345820>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:14.125387 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7a73e863-de63-4354-84d5-98af30b66f93 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:14.139633 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-7a73e863-de63-4354-84d5-98af30b66f93 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1279 microversion: 2.1 time: 0.198317 Jul 25 23:04:14.141181 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 22/42] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:13 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1279 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:14.224165 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-cf68405c-f068-4141-a140-9e1a923e1f06 tempest-VolumesTestJSON-688254254 tempest-VolumesTestJSON-688254254-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.140580 Jul 25 23:04:14.225043 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 21/43] 10.222.0.55 () {58 vars in 1170 bytes} [Mon Jul 25 23:04:14 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:04:14.243397 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-3e3c4364-39aa-40a5-b9c8-66ae580c03b3 tempest-VolumesTestJSON-688254254 tempest-VolumesTestJSON-688254254-project] Calling method '.version_select at 0x7f622c3194c0>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:14.424828 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-3e3c4364-39aa-40a5-b9c8-66ae580c03b3 tempest-VolumesTestJSON-688254254 tempest-VolumesTestJSON-688254254-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.186049 Jul 25 23:04:14.425435 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 23/44] 10.222.0.55 () {58 vars in 1155 bytes} [Mon Jul 25 23:04:14 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:14.437336 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell0:SELECT=2 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:14.441764 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-9ebe61c4-012d-49c0-bc4e-3cde22cd24c2 tempest-VolumesTestJSON-688254254 tempest-VolumesTestJSON-688254254-project] Calling method '.version_select at 0x7f622c2e61f0>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:14.717062 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-9ebe61c4-012d-49c0-bc4e-3cde22cd24c2 tempest-VolumesTestJSON-688254254 tempest-VolumesTestJSON-688254254-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.246658 Jul 25 23:04:14.717062 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 22/45] 10.222.0.55 () {58 vars in 1188 bytes} [Mon Jul 25 23:04:14 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:04:14.718832 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-225f7dbc-45da-4e36-82bc-43d6d195c6d5 tempest-VolumesTestJSON-688254254 tempest-VolumesTestJSON-688254254-project] Calling method '.version_select at 0x7f622c2e2b80>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:14.913494 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-225f7dbc-45da-4e36-82bc-43d6d195c6d5 tempest-VolumesTestJSON-688254254 tempest-VolumesTestJSON-688254254-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.208819 Jul 25 23:04:14.915145 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 24/46] 10.222.0.55 () {58 vars in 1155 bytes} [Mon Jul 25 23:04:14 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:15.108290 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-8d0912a3-b7e7-4256-8296-170dac7a49a9 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:15.108914 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-8d0912a3-b7e7-4256-8296-170dac7a49a9 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:15.151783 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8d0912a3-b7e7-4256-8296-170dac7a49a9 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:15.165955 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-697b3245-ceb4-4d05-b2b4-ac3de85efec0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:15.166235 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8d0912a3-b7e7-4256-8296-170dac7a49a9 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:15.166330 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-697b3245-ceb4-4d05-b2b4-ac3de85efec0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:15.170341 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8d0912a3-b7e7-4256-8296-170dac7a49a9 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:15.171782 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8d0912a3-b7e7-4256-8296-170dac7a49a9 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:15.192240 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-697b3245-ceb4-4d05-b2b4-ac3de85efec0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:15.201273 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-697b3245-ceb4-4d05-b2b4-ac3de85efec0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:15.206177 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-697b3245-ceb4-4d05-b2b4-ac3de85efec0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:15.208067 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-697b3245-ceb4-4d05-b2b4-ac3de85efec0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:16.347556 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-8d0912a3-b7e7-4256-8296-170dac7a49a9 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:16.367453 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-8d0912a3-b7e7-4256-8296-170dac7a49a9 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1314 microversion: 2.1 time: 1.263482 Jul 25 23:04:16.388392 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 23/47] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:15 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1314 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:16.618493 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-697b3245-ceb4-4d05-b2b4-ac3de85efec0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:16.630441 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-697b3245-ceb4-4d05-b2b4-ac3de85efec0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1321 microversion: 2.1 time: 1.473508 Jul 25 23:04:16.637487 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 25/48] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:15 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1321 bytes in 1477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:17.405441 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-29cc993b-2ed6-467f-b2d4-0521d66488df tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:17.407105 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-29cc993b-2ed6-467f-b2d4-0521d66488df tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:17.425815 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-29cc993b-2ed6-467f-b2d4-0521d66488df tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:17.430950 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-29cc993b-2ed6-467f-b2d4-0521d66488df tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:17.433841 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-29cc993b-2ed6-467f-b2d4-0521d66488df tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:17.434524 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-29cc993b-2ed6-467f-b2d4-0521d66488df tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:17.655461 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c56a563d-3751-4bea-8b69-8f172fa8d5b7 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:17.656788 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c56a563d-3751-4bea-8b69-8f172fa8d5b7 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:17.659073 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=4 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:17.675075 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c56a563d-3751-4bea-8b69-8f172fa8d5b7 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:17.676385 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c56a563d-3751-4bea-8b69-8f172fa8d5b7 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:17.677371 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c56a563d-3751-4bea-8b69-8f172fa8d5b7 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:17.677976 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c56a563d-3751-4bea-8b69-8f172fa8d5b7 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:18.151399 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-29cc993b-2ed6-467f-b2d4-0521d66488df tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:18.189536 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-29cc993b-2ed6-467f-b2d4-0521d66488df tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1314 microversion: 2.1 time: 0.780113 Jul 25 23:04:18.189536 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 24/49] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:17 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1314 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:18.351248 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-c60719a1-deae-40e9-abe7-ee4e8affbc6a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1024893170", "imageRef": "8e9f3265-0fdf-483a-8e2e-41d408f5f0e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "09c1c1f4-d415-48ff-a3a2-a8d6dd2d762b"}], "security_groups": [{"name": "tempest-securitygroup--960063839"}], "key_name": "tempest-keypair-1999345081", "user_data": "}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:04:18.978441 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c56a563d-3751-4bea-8b69-8f172fa8d5b7 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:18.991907 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c56a563d-3751-4bea-8b69-8f172fa8d5b7 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1321 microversion: 2.1 time: 1.340434 Jul 25 23:04:19.000340 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.network.neutron [None req-c60719a1-deae-40e9-abe7-ee4e8affbc6a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] validate_networks() for [('09c1c1f4-d415-48ff-a3a2-a8d6dd2d762b', None, None, None, None, None)] {{(pid=118409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 23:04:19.006938 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 26/50] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:17 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1321 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:04:19.202562 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-115c7e99-29f6-4967-97c1-b7a55773cba9 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:19.203602 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-115c7e99-29f6-4967-97c1-b7a55773cba9 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:19.213918 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-115c7e99-29f6-4967-97c1-b7a55773cba9 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:19.217593 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-115c7e99-29f6-4967-97c1-b7a55773cba9 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:19.220108 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-115c7e99-29f6-4967-97c1-b7a55773cba9 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:19.224642 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-115c7e99-29f6-4967-97c1-b7a55773cba9 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:19.305463 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=18 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:19.484442 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell0:SELECT=22 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:20.136059 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-115c7e99-29f6-4967-97c1-b7a55773cba9 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:20.151986 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-115c7e99-29f6-4967-97c1-b7a55773cba9 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1314 microversion: 2.1 time: 0.953163 Jul 25 23:04:20.169562 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 27/51] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:19 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1314 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:20.184989 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-aecdb9b4-1f5c-42e4-84dc-4f33ed3d184d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1501384094", "imageRef": "8e9f3265-0fdf-483a-8e2e-41d408f5f0e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f0e09cb6-a848-408f-8402-d9909d56acd7"}], "security_groups": [{"name": "tempest-securitygroup--1985554981"}], "key_name": "tempest-keypair-488966017", "user_data": "}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:04:20.908233 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-c60719a1-deae-40e9-abe7-ee4e8affbc6a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Flavor limits 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 23:04:20.908851 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-c60719a1-deae-40e9-abe7-ee4e8affbc6a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Image limits 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 23:04:20.909891 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-c60719a1-deae-40e9-abe7-ee4e8affbc6a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Flavor pref 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 23:04:20.915827 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-c60719a1-deae-40e9-abe7-ee4e8affbc6a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Image pref 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 23:04:20.915827 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-c60719a1-deae-40e9-abe7-ee4e8affbc6a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 23:04:20.952688 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c60719a1-deae-40e9-abe7-ee4e8affbc6a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:20.953148 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c60719a1-deae-40e9-abe7-ee4e8affbc6a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:20.953964 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c60719a1-deae-40e9-abe7-ee4e8affbc6a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:20.954406 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c60719a1-deae-40e9-abe7-ee4e8affbc6a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:21.039388 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-c60719a1-deae-40e9-abe7-ee4e8affbc6a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Getting quotas for project f0c3fc0630dd4083bcc8a9f70af99463. Resources: {'instances', 'cores', 'ram'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 23:04:21.070954 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-c60719a1-deae-40e9-abe7-ee4e8affbc6a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Getting quotas for user 4eea5a29c87d431299b220e404fd5732 and project f0c3fc0630dd4083bcc8a9f70af99463. Resources: {'instances', 'cores', 'ram'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 23:04:21.113358 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-c60719a1-deae-40e9-abe7-ee4e8affbc6a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Going to run 1 instances... {{(pid=118409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 23:04:21.117716 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-c60719a1-deae-40e9-abe7-ee4e8affbc6a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e9f3265-0fdf-483a-8e2e-41d408f5f0e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 23:04:21.370918 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-c60719a1-deae-40e9-abe7-ee4e8affbc6a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.025473 Jul 25 23:04:21.386822 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 25/52] 10.222.0.55 () {60 vars in 1147 bytes} [Mon Jul 25 23:04:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 3047 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 23:04:21.406662 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-cd791d8b-1364-4650-ab0f-f0d240255fd3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:21.414927 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-cd791d8b-1364-4650-ab0f-f0d240255fd3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:21.474230 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cd791d8b-1364-4650-ab0f-f0d240255fd3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:21.474710 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cd791d8b-1364-4650-ab0f-f0d240255fd3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:21.475536 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cd791d8b-1364-4650-ab0f-f0d240255fd3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:21.475982 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cd791d8b-1364-4650-ab0f-f0d240255fd3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:21.994534 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.network.neutron [None req-aecdb9b4-1f5c-42e4-84dc-4f33ed3d184d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] validate_networks() for [('f0e09cb6-a848-408f-8402-d9909d56acd7', None, None, None, None, None)] {{(pid=118410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 23:04:22.976490 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-cd791d8b-1364-4650-ab0f-f0d240255fd3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:22.988454 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-cd791d8b-1364-4650-ab0f-f0d240255fd3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1321 microversion: 2.1 time: 1.599709 Jul 25 23:04:22.993643 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 26/53] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:21 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1321 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:23.483731 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-ef5a443a-766b-4ecc-8ac3-abac8ac81fd3 req-db213897-6567-48bd-9666-a5e14c904c5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad", "tag": "2dda7df4-b839-4b39-8a4c-076a67b464e7"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:04:23.518159 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-ef5a443a-766b-4ecc-8ac3-abac8ac81fd3 req-db213897-6567-48bd-9666-a5e14c904c5d service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:23.520115 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-ef5a443a-766b-4ecc-8ac3-abac8ac81fd3 req-db213897-6567-48bd-9666-a5e14c904c5d service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:23.592531 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-ef5a443a-766b-4ecc-8ac3-abac8ac81fd3 req-db213897-6567-48bd-9666-a5e14c904c5d service nova] Creating event network-changed:2dda7df4-b839-4b39-8a4c-076a67b464e7 for instance be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad on hv-cinder-79760 Jul 25 23:04:23.624495 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-ef5a443a-766b-4ecc-8ac3-abac8ac81fd3 req-db213897-6567-48bd-9666-a5e14c904c5d service nova] Acquired lock "compute-rpcapi-router" {{(pid=118409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 23:04:23.627821 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-66e3719c-8fbe-42fd-b9e1-c98540335f03 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:23.630851 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-66e3719c-8fbe-42fd-b9e1-c98540335f03 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:23.643997 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-66e3719c-8fbe-42fd-b9e1-c98540335f03 None None] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:23.643997 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-66e3719c-8fbe-42fd-b9e1-c98540335f03 None None] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:23.664556 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.compute.rpcapi [None req-66e3719c-8fbe-42fd-b9e1-c98540335f03 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 25 23:04:23.672337 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-66e3719c-8fbe-42fd-b9e1-c98540335f03 None None] Releasing lock "compute-rpcapi-router" {{(pid=118409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 23:04:23.726070 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-66e3719c-8fbe-42fd-b9e1-c98540335f03 None None] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.731874 Jul 25 23:04:23.728382 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 27/54] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:04:23.769712 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-1f35c1b4-276a-4d6a-87cf-5d60b7199f6b tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:23.781281 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-1f35c1b4-276a-4d6a-87cf-5d60b7199f6b tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:23.797422 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1f35c1b4-276a-4d6a-87cf-5d60b7199f6b tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:23.808823 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1f35c1b4-276a-4d6a-87cf-5d60b7199f6b tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:23.825430 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1f35c1b4-276a-4d6a-87cf-5d60b7199f6b tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:23.825430 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1f35c1b4-276a-4d6a-87cf-5d60b7199f6b tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:24.335268 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-aecdb9b4-1f5c-42e4-84dc-4f33ed3d184d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Flavor limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 23:04:24.336376 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-aecdb9b4-1f5c-42e4-84dc-4f33ed3d184d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Image limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 23:04:24.337253 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-aecdb9b4-1f5c-42e4-84dc-4f33ed3d184d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Flavor pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 23:04:24.337859 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-aecdb9b4-1f5c-42e4-84dc-4f33ed3d184d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Image pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 23:04:24.339325 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-aecdb9b4-1f5c-42e4-84dc-4f33ed3d184d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 23:04:24.363246 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-aecdb9b4-1f5c-42e4-84dc-4f33ed3d184d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:24.363768 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-aecdb9b4-1f5c-42e4-84dc-4f33ed3d184d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:24.364833 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-aecdb9b4-1f5c-42e4-84dc-4f33ed3d184d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:24.367989 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-aecdb9b4-1f5c-42e4-84dc-4f33ed3d184d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:24.426873 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-aecdb9b4-1f5c-42e4-84dc-4f33ed3d184d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Getting quotas for project 16a417bb74d445f7b2240ccb27061f05. Resources: {'instances', 'cores', 'ram'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 23:04:24.439949 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-aecdb9b4-1f5c-42e4-84dc-4f33ed3d184d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Getting quotas for user fbc4fc1f207c4726b9c05b6b338f0e9c and project 16a417bb74d445f7b2240ccb27061f05. Resources: {'instances', 'cores', 'ram'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 23:04:24.475264 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-aecdb9b4-1f5c-42e4-84dc-4f33ed3d184d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Going to run 1 instances... {{(pid=118410) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 23:04:24.480697 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-aecdb9b4-1f5c-42e4-84dc-4f33ed3d184d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e9f3265-0fdf-483a-8e2e-41d408f5f0e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 23:04:24.709363 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-1f35c1b4-276a-4d6a-87cf-5d60b7199f6b tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:24.720526 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-1f35c1b4-276a-4d6a-87cf-5d60b7199f6b tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1314 microversion: 2.1 time: 0.977184 Jul 25 23:04:24.721689 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 28/55] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:23 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1314 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:24.726788 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-c457b826-ce1b-41d7-93ec-02f310fab7d1 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:24.727609 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-c457b826-ce1b-41d7-93ec-02f310fab7d1 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:24.745959 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c457b826-ce1b-41d7-93ec-02f310fab7d1 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:24.747875 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c457b826-ce1b-41d7-93ec-02f310fab7d1 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:24.748865 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c457b826-ce1b-41d7-93ec-02f310fab7d1 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:24.749706 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c457b826-ce1b-41d7-93ec-02f310fab7d1 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:24.834931 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-c457b826-ce1b-41d7-93ec-02f310fab7d1 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:24.848587 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-c457b826-ce1b-41d7-93ec-02f310fab7d1 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1242 microversion: 2.1 time: 0.125545 Jul 25 23:04:24.850804 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 29/56] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:24 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1242 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:24.875656 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-aecdb9b4-1f5c-42e4-84dc-4f33ed3d184d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.701714 Jul 25 23:04:24.877467 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 28/57] 10.222.0.55 () {62 vars in 1188 bytes} [Mon Jul 25 23:04:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 4706 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 23:04:24.882366 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b96cfbe1-bf7f-425d-9fc5-e151f9902f92 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:24.894592 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b96cfbe1-bf7f-425d-9fc5-e151f9902f92 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:24.905350 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b96cfbe1-bf7f-425d-9fc5-e151f9902f92 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:24.918238 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b96cfbe1-bf7f-425d-9fc5-e151f9902f92 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:24.920598 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b96cfbe1-bf7f-425d-9fc5-e151f9902f92 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:24.922034 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b96cfbe1-bf7f-425d-9fc5-e151f9902f92 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:25.278246 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b96cfbe1-bf7f-425d-9fc5-e151f9902f92 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:25.287723 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b96cfbe1-bf7f-425d-9fc5-e151f9902f92 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1321 microversion: 2.1 time: 0.408906 Jul 25 23:04:25.303691 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 29/58] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:24 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1321 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:25.309459 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-fcff079d-3433-4aad-8c90-97751ef480bf tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:25.309995 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-fcff079d-3433-4aad-8c90-97751ef480bf tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:25.388508 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-4ce97e7e-269e-4033-884d-b6af9f53c2a4 req-ec8239cf-e57d-4053-8bc0-4c117994e700 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f79f5efc-af32-4b3a-975a-aef5b386752f", "tag": "adb509d8-1477-472c-bb38-e69e5cdd5c19"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:04:25.439447 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-4ce97e7e-269e-4033-884d-b6af9f53c2a4 req-ec8239cf-e57d-4053-8bc0-4c117994e700 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:25.439907 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-4ce97e7e-269e-4033-884d-b6af9f53c2a4 req-ec8239cf-e57d-4053-8bc0-4c117994e700 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:25.472333 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-fcff079d-3433-4aad-8c90-97751ef480bf tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:25.486403 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-fcff079d-3433-4aad-8c90-97751ef480bf tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:25.488574 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-fcff079d-3433-4aad-8c90-97751ef480bf tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:25.490850 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-fcff079d-3433-4aad-8c90-97751ef480bf tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1281 microversion: 2.20 time: 0.185277 Jul 25 23:04:25.508459 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-4ce97e7e-269e-4033-884d-b6af9f53c2a4 req-ec8239cf-e57d-4053-8bc0-4c117994e700 service nova] Creating event network-changed:adb509d8-1477-472c-bb38-e69e5cdd5c19 for instance f79f5efc-af32-4b3a-975a-aef5b386752f on hv-cinder-79760 Jul 25 23:04:25.508619 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 30/59] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:04:25 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1281 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:04:25.508714 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-4ce97e7e-269e-4033-884d-b6af9f53c2a4 req-ec8239cf-e57d-4053-8bc0-4c117994e700 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.649788 Jul 25 23:04:25.508714 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 30/60] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:04:25.750945 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-9c157b0e-e382-4e2c-a430-4f403cc5ec78 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:25.751837 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-9c157b0e-e382-4e2c-a430-4f403cc5ec78 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:25.760861 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-f81fb70c-6b96-4080-8294-1a839a1c68cd req-a3ee34c2-b227-44bf-b350-68fd8bad3541 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06fcf0b9-57d3-4abb-8b39-cf03d104f2a8", "tag": "3362c499-c419-49ff-9af6-1d14b8fe4fcb"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:04:25.762614 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9c157b0e-e382-4e2c-a430-4f403cc5ec78 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:25.763318 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9c157b0e-e382-4e2c-a430-4f403cc5ec78 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:25.764838 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9c157b0e-e382-4e2c-a430-4f403cc5ec78 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:25.765912 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9c157b0e-e382-4e2c-a430-4f403cc5ec78 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:25.852386 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-f81fb70c-6b96-4080-8294-1a839a1c68cd req-a3ee34c2-b227-44bf-b350-68fd8bad3541 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:25.871058 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-f81fb70c-6b96-4080-8294-1a839a1c68cd req-a3ee34c2-b227-44bf-b350-68fd8bad3541 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:25.975361 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-f81fb70c-6b96-4080-8294-1a839a1c68cd req-a3ee34c2-b227-44bf-b350-68fd8bad3541 service nova] Creating event network-changed:3362c499-c419-49ff-9af6-1d14b8fe4fcb for instance 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 on hv-cinder-79760 Jul 25 23:04:25.975361 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-f81fb70c-6b96-4080-8294-1a839a1c68cd req-a3ee34c2-b227-44bf-b350-68fd8bad3541 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118410) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 25 23:04:25.975361 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-75e67a3f-3194-478a-b2be-ad7d83978b0d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:25.990698 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-75e67a3f-3194-478a-b2be-ad7d83978b0d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:25.992070 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-75e67a3f-3194-478a-b2be-ad7d83978b0d None None] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:25.994202 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-75e67a3f-3194-478a-b2be-ad7d83978b0d None None] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:26.034848 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.compute.rpcapi [None req-75e67a3f-3194-478a-b2be-ad7d83978b0d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 25 23:04:26.046125 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-75e67a3f-3194-478a-b2be-ad7d83978b0d None None] Releasing lock "compute-rpcapi-router" {{(pid=118410) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 25 23:04:26.111305 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-75e67a3f-3194-478a-b2be-ad7d83978b0d None None] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.369862 Jul 25 23:04:26.112298 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 31/61] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:04:26.124761 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e8a63447-17dd-4a7d-9ccf-0704ea83a1b5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:26.131801 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e8a63447-17dd-4a7d-9ccf-0704ea83a1b5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:26.158381 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e8a63447-17dd-4a7d-9ccf-0704ea83a1b5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:26.163559 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e8a63447-17dd-4a7d-9ccf-0704ea83a1b5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:26.165964 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e8a63447-17dd-4a7d-9ccf-0704ea83a1b5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:26.167803 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e8a63447-17dd-4a7d-9ccf-0704ea83a1b5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:26.328480 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-9c157b0e-e382-4e2c-a430-4f403cc5ec78 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:26.351615 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-9c157b0e-e382-4e2c-a430-4f403cc5ec78 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1314 microversion: 2.1 time: 0.607740 Jul 25 23:04:26.372647 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 31/62] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:25 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1314 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:04:26.384606 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-24afaded-de20-44bf-bffd-70449e89520a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:26.390938 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-24afaded-de20-44bf-bffd-70449e89520a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:26.415122 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-24afaded-de20-44bf-bffd-70449e89520a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:26.415580 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-24afaded-de20-44bf-bffd-70449e89520a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:26.424168 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-24afaded-de20-44bf-bffd-70449e89520a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:26.424665 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-24afaded-de20-44bf-bffd-70449e89520a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:26.471659 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e8a63447-17dd-4a7d-9ccf-0704ea83a1b5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:26.484062 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e8a63447-17dd-4a7d-9ccf-0704ea83a1b5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1290 microversion: 2.1 time: 0.368794 Jul 25 23:04:26.519152 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 32/63] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:26 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1290 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:26.541778 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-58c397ce-3119-45ab-9774-2b91718be38c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:26.545724 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-58c397ce-3119-45ab-9774-2b91718be38c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:26.802617 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-58c397ce-3119-45ab-9774-2b91718be38c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:26.811165 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-58c397ce-3119-45ab-9774-2b91718be38c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:26.821558 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-58c397ce-3119-45ab-9774-2b91718be38c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:26.826807 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-58c397ce-3119-45ab-9774-2b91718be38c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1281 microversion: 2.20 time: 0.306114 Jul 25 23:04:26.833796 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 33/64] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:04:26 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1281 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:04:27.396798 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b50a8674-9e05-454a-856f-760e5a57c729 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:27.403119 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b50a8674-9e05-454a-856f-760e5a57c729 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:27.432941 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b50a8674-9e05-454a-856f-760e5a57c729 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:27.433547 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b50a8674-9e05-454a-856f-760e5a57c729 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:27.434346 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b50a8674-9e05-454a-856f-760e5a57c729 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:27.442113 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b50a8674-9e05-454a-856f-760e5a57c729 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:27.713705 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-24afaded-de20-44bf-bffd-70449e89520a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:27.726613 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-24afaded-de20-44bf-bffd-70449e89520a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1321 microversion: 2.1 time: 1.348899 Jul 25 23:04:27.729187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 32/65] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:26 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1321 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:27.741896 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-cf1c7d57-bbc2-4d34-891c-843abfd2d125 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:27.746166 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-cf1c7d57-bbc2-4d34-891c-843abfd2d125 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:27.758847 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cf1c7d57-bbc2-4d34-891c-843abfd2d125 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:27.761617 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cf1c7d57-bbc2-4d34-891c-843abfd2d125 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:27.762718 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cf1c7d57-bbc2-4d34-891c-843abfd2d125 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:27.763306 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cf1c7d57-bbc2-4d34-891c-843abfd2d125 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:28.012862 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-cf1c7d57-bbc2-4d34-891c-843abfd2d125 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:28.030886 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-cf1c7d57-bbc2-4d34-891c-843abfd2d125 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1308 microversion: 2.1 time: 0.292544 Jul 25 23:04:28.037411 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 33/66] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:27 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1308 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:28.046895 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-845623b9-0f9c-4d59-87a1-3ee1798f77af tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:28.048863 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-845623b9-0f9c-4d59-87a1-3ee1798f77af tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:28.056996 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:28.066344 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-845623b9-0f9c-4d59-87a1-3ee1798f77af tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:28.068931 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-845623b9-0f9c-4d59-87a1-3ee1798f77af tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:28.070315 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-845623b9-0f9c-4d59-87a1-3ee1798f77af tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:28.070774 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-845623b9-0f9c-4d59-87a1-3ee1798f77af tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:28.373055 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-845623b9-0f9c-4d59-87a1-3ee1798f77af tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:28.380395 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b50a8674-9e05-454a-856f-760e5a57c729 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:28.392980 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b50a8674-9e05-454a-856f-760e5a57c729 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1314 microversion: 2.1 time: 1.000393 Jul 25 23:04:28.405981 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-845623b9-0f9c-4d59-87a1-3ee1798f77af tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:28.406679 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 34/67] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:27 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1314 bytes in 1015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:04:28.409267 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-845623b9-0f9c-4d59-87a1-3ee1798f77af tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:28.412569 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-845623b9-0f9c-4d59-87a1-3ee1798f77af tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1277 microversion: 2.20 time: 0.374096 Jul 25 23:04:28.422172 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 34/68] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:04:28 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1277 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:04:28.753915 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e4da6521-0a96-4680-8ff4-a4425053553e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:28.754836 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e4da6521-0a96-4680-8ff4-a4425053553e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:28.779897 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e4da6521-0a96-4680-8ff4-a4425053553e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:28.780539 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e4da6521-0a96-4680-8ff4-a4425053553e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:28.781414 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e4da6521-0a96-4680-8ff4-a4425053553e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:28.781852 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e4da6521-0a96-4680-8ff4-a4425053553e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:29.058535 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-886460f2-fe2f-4d54-9c8f-3dbf73d500bd tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:29.059212 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-886460f2-fe2f-4d54-9c8f-3dbf73d500bd tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:29.074315 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-886460f2-fe2f-4d54-9c8f-3dbf73d500bd tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:29.074898 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-886460f2-fe2f-4d54-9c8f-3dbf73d500bd tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:29.076497 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-886460f2-fe2f-4d54-9c8f-3dbf73d500bd tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:29.076946 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-886460f2-fe2f-4d54-9c8f-3dbf73d500bd tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:29.334108 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-886460f2-fe2f-4d54-9c8f-3dbf73d500bd tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:29.372800 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-886460f2-fe2f-4d54-9c8f-3dbf73d500bd tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1296 microversion: 2.1 time: 0.317499 Jul 25 23:04:29.374395 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 35/69] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:29 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1296 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:04:29.417411 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-797dd0e0-36b2-48e9-91b5-406bfff7c85a tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:29.418288 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-797dd0e0-36b2-48e9-91b5-406bfff7c85a tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:29.429959 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-797dd0e0-36b2-48e9-91b5-406bfff7c85a tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:29.431073 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-797dd0e0-36b2-48e9-91b5-406bfff7c85a tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:29.434201 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-797dd0e0-36b2-48e9-91b5-406bfff7c85a tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:29.436221 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-797dd0e0-36b2-48e9-91b5-406bfff7c85a tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:29.482002 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e4da6521-0a96-4680-8ff4-a4425053553e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:29.496054 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e4da6521-0a96-4680-8ff4-a4425053553e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1321 microversion: 2.1 time: 0.747287 Jul 25 23:04:29.497826 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 35/70] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:28 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1321 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:29.510706 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-1b737d9f-0352-41ab-87fa-aba2592a818a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:29.515701 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-1b737d9f-0352-41ab-87fa-aba2592a818a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:29.529335 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:29.536906 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1b737d9f-0352-41ab-87fa-aba2592a818a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:29.538208 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1b737d9f-0352-41ab-87fa-aba2592a818a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:29.539461 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1b737d9f-0352-41ab-87fa-aba2592a818a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:29.540049 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1b737d9f-0352-41ab-87fa-aba2592a818a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:29.704248 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-1b737d9f-0352-41ab-87fa-aba2592a818a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:29.717174 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-1b737d9f-0352-41ab-87fa-aba2592a818a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:29.718714 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-1b737d9f-0352-41ab-87fa-aba2592a818a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:29.719829 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-1b737d9f-0352-41ab-87fa-aba2592a818a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1341 microversion: 2.20 time: 0.219935 Jul 25 23:04:29.720382 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 36/71] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:04:29 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1341 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:04:29.926187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-797dd0e0-36b2-48e9-91b5-406bfff7c85a tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:29.930073 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=100 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:29.958810 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-797dd0e0-36b2-48e9-91b5-406bfff7c85a tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1314 microversion: 2.1 time: 0.546657 Jul 25 23:04:29.971647 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 36/72] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:29 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1314 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:04:30.411454 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f97bb10b-0e05-44d1-a719-e9fb0964f5da tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:30.412052 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f97bb10b-0e05-44d1-a719-e9fb0964f5da tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:30.419156 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f97bb10b-0e05-44d1-a719-e9fb0964f5da tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:30.419605 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f97bb10b-0e05-44d1-a719-e9fb0964f5da tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:30.420367 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f97bb10b-0e05-44d1-a719-e9fb0964f5da tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:30.420792 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f97bb10b-0e05-44d1-a719-e9fb0964f5da tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:30.544161 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-15f42cbd-5f0a-478d-854b-3e3f60330806 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:30.545592 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-15f42cbd-5f0a-478d-854b-3e3f60330806 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:30.552770 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-15f42cbd-5f0a-478d-854b-3e3f60330806 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:30.557278 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-15f42cbd-5f0a-478d-854b-3e3f60330806 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:30.557278 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-15f42cbd-5f0a-478d-854b-3e3f60330806 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:30.557278 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-15f42cbd-5f0a-478d-854b-3e3f60330806 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:30.735363 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f97bb10b-0e05-44d1-a719-e9fb0964f5da tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:30.746018 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f97bb10b-0e05-44d1-a719-e9fb0964f5da tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1363 microversion: 2.1 time: 0.338313 Jul 25 23:04:30.747932 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 37/73] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:30 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1363 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:30.761317 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c3bfd9cb-a789-4f18-a397-577dd7cbf614 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:30.762245 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c3bfd9cb-a789-4f18-a397-577dd7cbf614 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:30.775868 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c3bfd9cb-a789-4f18-a397-577dd7cbf614 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:30.776811 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c3bfd9cb-a789-4f18-a397-577dd7cbf614 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:30.779842 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c3bfd9cb-a789-4f18-a397-577dd7cbf614 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:30.780801 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c3bfd9cb-a789-4f18-a397-577dd7cbf614 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:30.989621 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c3bfd9cb-a789-4f18-a397-577dd7cbf614 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:31.027533 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c3bfd9cb-a789-4f18-a397-577dd7cbf614 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:31.029483 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-15f42cbd-5f0a-478d-854b-3e3f60330806 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:31.032971 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c3bfd9cb-a789-4f18-a397-577dd7cbf614 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:31.035916 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c3bfd9cb-a789-4f18-a397-577dd7cbf614 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1339 microversion: 2.20 time: 0.285440 Jul 25 23:04:31.040081 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 38/74] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:04:30 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1339 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:04:31.046108 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-15f42cbd-5f0a-478d-854b-3e3f60330806 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1321 microversion: 2.1 time: 0.507123 Jul 25 23:04:31.047953 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 37/75] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:30 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1321 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:31.055811 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e6fdcc39-1b39-43b6-a3df-813f47015b1b tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:31.057544 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e6fdcc39-1b39-43b6-a3df-813f47015b1b tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:31.068266 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e6fdcc39-1b39-43b6-a3df-813f47015b1b tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:31.069001 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e6fdcc39-1b39-43b6-a3df-813f47015b1b tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:31.069992 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e6fdcc39-1b39-43b6-a3df-813f47015b1b tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:31.070583 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e6fdcc39-1b39-43b6-a3df-813f47015b1b tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:31.185715 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-ee4dcc5b-a421-45c4-bbcc-d3e9faf6e3d6 req-1a8d24ed-70ae-4ebe-adc3-a2b9b9d48728 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6efbf144-c03b-44d4-ad8f-0382560ed59d", "tag": "0d5cf52c-9ff5-4944-b3a7-c07d730ee932"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:04:31.198065 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell0:SELECT=6 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:31.203476 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-ee4dcc5b-a421-45c4-bbcc-d3e9faf6e3d6 req-1a8d24ed-70ae-4ebe-adc3-a2b9b9d48728 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:31.204300 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-ee4dcc5b-a421-45c4-bbcc-d3e9faf6e3d6 req-1a8d24ed-70ae-4ebe-adc3-a2b9b9d48728 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:31.222609 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-ee4dcc5b-a421-45c4-bbcc-d3e9faf6e3d6 req-1a8d24ed-70ae-4ebe-adc3-a2b9b9d48728 service nova] Creating event network-changed:0d5cf52c-9ff5-4944-b3a7-c07d730ee932 for instance 6efbf144-c03b-44d4-ad8f-0382560ed59d on hv-cinder-79760 Jul 25 23:04:31.230925 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-ee4dcc5b-a421-45c4-bbcc-d3e9faf6e3d6 req-1a8d24ed-70ae-4ebe-adc3-a2b9b9d48728 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048343 Jul 25 23:04:31.230925 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 38/76] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 23:04:31.287553 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e6fdcc39-1b39-43b6-a3df-813f47015b1b tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:31.291599 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=100 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:31.299840 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e6fdcc39-1b39-43b6-a3df-813f47015b1b tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1314 microversion: 2.1 time: 0.254893 Jul 25 23:04:31.299840 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 39/77] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:31 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:31.774255 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-17b8e0fe-80ec-4f8b-8c18-b4110c56ab40 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:31.774987 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-17b8e0fe-80ec-4f8b-8c18-b4110c56ab40 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:31.797918 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-17b8e0fe-80ec-4f8b-8c18-b4110c56ab40 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:31.799129 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-17b8e0fe-80ec-4f8b-8c18-b4110c56ab40 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:31.800684 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-17b8e0fe-80ec-4f8b-8c18-b4110c56ab40 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:31.801358 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-17b8e0fe-80ec-4f8b-8c18-b4110c56ab40 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:31.962134 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-17b8e0fe-80ec-4f8b-8c18-b4110c56ab40 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:31.974537 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-17b8e0fe-80ec-4f8b-8c18-b4110c56ab40 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1363 microversion: 2.1 time: 0.205121 Jul 25 23:04:31.975340 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 39/78] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:31 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1363 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:32.065763 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-1e0b364d-c2cc-4082-86d6-d3768bb54246 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:32.066509 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-1e0b364d-c2cc-4082-86d6-d3768bb54246 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:32.071391 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-7403cfe4-6ee8-4ae8-b6ac-d7f8e9279290 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:32.072030 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-7403cfe4-6ee8-4ae8-b6ac-d7f8e9279290 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:32.075119 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1e0b364d-c2cc-4082-86d6-d3768bb54246 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:32.075649 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1e0b364d-c2cc-4082-86d6-d3768bb54246 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:32.076978 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1e0b364d-c2cc-4082-86d6-d3768bb54246 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:32.077404 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1e0b364d-c2cc-4082-86d6-d3768bb54246 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:32.088639 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7403cfe4-6ee8-4ae8-b6ac-d7f8e9279290 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:32.089091 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7403cfe4-6ee8-4ae8-b6ac-d7f8e9279290 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:32.089964 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7403cfe4-6ee8-4ae8-b6ac-d7f8e9279290 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:32.090394 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7403cfe4-6ee8-4ae8-b6ac-d7f8e9279290 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:32.284823 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-1e0b364d-c2cc-4082-86d6-d3768bb54246 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:32.292544 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-7403cfe4-6ee8-4ae8-b6ac-d7f8e9279290 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:32.293292 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-1e0b364d-c2cc-4082-86d6-d3768bb54246 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:32.295295 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-1e0b364d-c2cc-4082-86d6-d3768bb54246 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:32.297844 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-1e0b364d-c2cc-4082-86d6-d3768bb54246 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1407 microversion: 2.20 time: 0.237011 Jul 25 23:04:32.298851 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 40/79] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:04:32 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:04:32.302011 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-7403cfe4-6ee8-4ae8-b6ac-d7f8e9279290 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1321 microversion: 2.1 time: 0.234363 Jul 25 23:04:32.302573 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 40/80] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:32 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:04:32.320087 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-fed92149-6ec4-42f7-8af7-a5c169ad599b tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:32.320684 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-fed92149-6ec4-42f7-8af7-a5c169ad599b tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:32.327522 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fed92149-6ec4-42f7-8af7-a5c169ad599b tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:32.327967 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fed92149-6ec4-42f7-8af7-a5c169ad599b tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:32.328736 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fed92149-6ec4-42f7-8af7-a5c169ad599b tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:32.329191 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fed92149-6ec4-42f7-8af7-a5c169ad599b tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:32.471560 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-fed92149-6ec4-42f7-8af7-a5c169ad599b tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:32.479584 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-fed92149-6ec4-42f7-8af7-a5c169ad599b tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1314 microversion: 2.1 time: 0.163256 Jul 25 23:04:32.480167 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 41/81] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:32 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:32.995889 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-7e05b778-7fce-4f08-b75b-3fde831f59b5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:32.996482 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-7e05b778-7fce-4f08-b75b-3fde831f59b5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:33.002462 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7e05b778-7fce-4f08-b75b-3fde831f59b5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:33.002901 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7e05b778-7fce-4f08-b75b-3fde831f59b5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:33.003646 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7e05b778-7fce-4f08-b75b-3fde831f59b5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:33.004076 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7e05b778-7fce-4f08-b75b-3fde831f59b5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:33.171082 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-7e05b778-7fce-4f08-b75b-3fde831f59b5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:33.178673 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-7e05b778-7fce-4f08-b75b-3fde831f59b5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1363 microversion: 2.1 time: 0.186704 Jul 25 23:04:33.179242 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 41/82] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:32 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:33.321795 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-53f9d155-85f8-41a4-8b33-cdb1c31b144b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:33.325266 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-53f9d155-85f8-41a4-8b33-cdb1c31b144b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:33.325393 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-f2a451f1-48f5-42bb-94fd-4daaa7d48081 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:33.325393 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-f2a451f1-48f5-42bb-94fd-4daaa7d48081 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:33.330370 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-53f9d155-85f8-41a4-8b33-cdb1c31b144b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:33.331040 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-53f9d155-85f8-41a4-8b33-cdb1c31b144b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:33.331543 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f2a451f1-48f5-42bb-94fd-4daaa7d48081 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:33.331996 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f2a451f1-48f5-42bb-94fd-4daaa7d48081 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:33.332399 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-53f9d155-85f8-41a4-8b33-cdb1c31b144b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:33.332766 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f2a451f1-48f5-42bb-94fd-4daaa7d48081 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:33.333214 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-53f9d155-85f8-41a4-8b33-cdb1c31b144b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:33.333336 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f2a451f1-48f5-42bb-94fd-4daaa7d48081 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:33.539863 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-f2a451f1-48f5-42bb-94fd-4daaa7d48081 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:33.550127 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-f2a451f1-48f5-42bb-94fd-4daaa7d48081 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1321 microversion: 2.1 time: 0.230106 Jul 25 23:04:33.550713 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 42/83] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:33 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:04:33.553546 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-53f9d155-85f8-41a4-8b33-cdb1c31b144b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:33.555188 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-317ca39c-5961-41e1-af7e-c84175b455f9 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:33.555793 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-317ca39c-5961-41e1-af7e-c84175b455f9 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:33.568862 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-53f9d155-85f8-41a4-8b33-cdb1c31b144b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:33.568995 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-317ca39c-5961-41e1-af7e-c84175b455f9 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:33.569409 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-317ca39c-5961-41e1-af7e-c84175b455f9 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:33.575176 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-317ca39c-5961-41e1-af7e-c84175b455f9 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:33.575176 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-317ca39c-5961-41e1-af7e-c84175b455f9 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:33.575505 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-53f9d155-85f8-41a4-8b33-cdb1c31b144b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:33.575505 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-53f9d155-85f8-41a4-8b33-cdb1c31b144b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1407 microversion: 2.20 time: 0.255367 Jul 25 23:04:33.575505 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 42/84] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:04:33 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:04:33.663122 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell0:SELECT=4 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:33.716978 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-317ca39c-5961-41e1-af7e-c84175b455f9 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:33.733869 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-317ca39c-5961-41e1-af7e-c84175b455f9 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1314 microversion: 2.1 time: 0.181796 Jul 25 23:04:33.734614 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 43/85] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:33 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:34.200575 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-8ab32b6f-72c1-4cee-8fb4-af877ad83fb5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:34.201294 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-8ab32b6f-72c1-4cee-8fb4-af877ad83fb5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:34.207614 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8ab32b6f-72c1-4cee-8fb4-af877ad83fb5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:34.208066 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8ab32b6f-72c1-4cee-8fb4-af877ad83fb5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:34.208825 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8ab32b6f-72c1-4cee-8fb4-af877ad83fb5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:34.209492 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8ab32b6f-72c1-4cee-8fb4-af877ad83fb5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:34.361586 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-8ab32b6f-72c1-4cee-8fb4-af877ad83fb5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:34.369891 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-8ab32b6f-72c1-4cee-8fb4-af877ad83fb5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1363 microversion: 2.1 time: 0.173257 Jul 25 23:04:34.370739 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 43/86] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:34 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:04:34.571036 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-5e3c4b0f-4412-4435-8b97-cccdedcf01b0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:34.571647 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-5e3c4b0f-4412-4435-8b97-cccdedcf01b0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:34.578786 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5e3c4b0f-4412-4435-8b97-cccdedcf01b0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:34.579226 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5e3c4b0f-4412-4435-8b97-cccdedcf01b0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:34.579991 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5e3c4b0f-4412-4435-8b97-cccdedcf01b0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:34.580420 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5e3c4b0f-4412-4435-8b97-cccdedcf01b0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:34.604567 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-7f81fc0c-6251-4e67-8f58-73dc75d4f35f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:34.605237 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-7f81fc0c-6251-4e67-8f58-73dc75d4f35f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:34.612025 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7f81fc0c-6251-4e67-8f58-73dc75d4f35f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:34.612474 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7f81fc0c-6251-4e67-8f58-73dc75d4f35f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:34.613278 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7f81fc0c-6251-4e67-8f58-73dc75d4f35f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:34.613811 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7f81fc0c-6251-4e67-8f58-73dc75d4f35f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:34.879477 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-5e3c4b0f-4412-4435-8b97-cccdedcf01b0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:34.884637 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7f81fc0c-6251-4e67-8f58-73dc75d4f35f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:34.887206 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-5e3c4b0f-4412-4435-8b97-cccdedcf01b0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1321 microversion: 2.1 time: 0.319990 Jul 25 23:04:34.888228 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 44/87] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:34 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1321 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:34.892578 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-cf0fc215-ccd6-4a3a-8c67-3bf74e4d49b1 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:34.893199 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-cf0fc215-ccd6-4a3a-8c67-3bf74e4d49b1 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:34.893449 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7f81fc0c-6251-4e67-8f58-73dc75d4f35f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:34.894990 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7f81fc0c-6251-4e67-8f58-73dc75d4f35f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:34.896095 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-7f81fc0c-6251-4e67-8f58-73dc75d4f35f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1407 microversion: 2.20 time: 0.295841 Jul 25 23:04:34.896642 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 44/88] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:04:34 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1407 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:04:34.899674 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cf0fc215-ccd6-4a3a-8c67-3bf74e4d49b1 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:34.900110 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cf0fc215-ccd6-4a3a-8c67-3bf74e4d49b1 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:34.900879 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cf0fc215-ccd6-4a3a-8c67-3bf74e4d49b1 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:34.901570 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cf0fc215-ccd6-4a3a-8c67-3bf74e4d49b1 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:35.094383 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-cf0fc215-ccd6-4a3a-8c67-3bf74e4d49b1 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:35.105817 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-cf0fc215-ccd6-4a3a-8c67-3bf74e4d49b1 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1314 microversion: 2.1 time: 0.216632 Jul 25 23:04:35.106402 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 45/89] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:34 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:35.391221 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b12cceeb-0334-4ed8-b503-b3a68d83ef16 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:35.391885 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b12cceeb-0334-4ed8-b503-b3a68d83ef16 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:35.398120 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b12cceeb-0334-4ed8-b503-b3a68d83ef16 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:35.398555 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b12cceeb-0334-4ed8-b503-b3a68d83ef16 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:35.399300 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b12cceeb-0334-4ed8-b503-b3a68d83ef16 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:35.399727 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b12cceeb-0334-4ed8-b503-b3a68d83ef16 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:35.576611 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b12cceeb-0334-4ed8-b503-b3a68d83ef16 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:35.584167 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b12cceeb-0334-4ed8-b503-b3a68d83ef16 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1363 microversion: 2.1 time: 0.196792 Jul 25 23:04:35.584729 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 45/90] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:35 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:35.910500 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-e053869c-c3f2-426a-947a-b67b3b97c588 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:35.911949 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-e053869c-c3f2-426a-947a-b67b3b97c588 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:35.918320 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e053869c-c3f2-426a-947a-b67b3b97c588 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:35.918764 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e053869c-c3f2-426a-947a-b67b3b97c588 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:35.919704 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e053869c-c3f2-426a-947a-b67b3b97c588 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:35.919898 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6ff54adb-9e6b-4b6a-b262-99ebef3291a8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:35.920139 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e053869c-c3f2-426a-947a-b67b3b97c588 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:35.920797 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6ff54adb-9e6b-4b6a-b262-99ebef3291a8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:35.927437 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6ff54adb-9e6b-4b6a-b262-99ebef3291a8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:35.928032 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6ff54adb-9e6b-4b6a-b262-99ebef3291a8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:35.928888 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6ff54adb-9e6b-4b6a-b262-99ebef3291a8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:35.929505 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6ff54adb-9e6b-4b6a-b262-99ebef3291a8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:36.030263 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=4 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:36.127539 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-e053869c-c3f2-426a-947a-b67b3b97c588 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:36.130676 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6ff54adb-9e6b-4b6a-b262-99ebef3291a8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:36.139638 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6ff54adb-9e6b-4b6a-b262-99ebef3291a8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:36.140762 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-e053869c-c3f2-426a-947a-b67b3b97c588 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1321 microversion: 2.1 time: 0.236306 Jul 25 23:04:36.141133 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6ff54adb-9e6b-4b6a-b262-99ebef3291a8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:36.141369 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 46/91] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:35 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:36.149294 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6ff54adb-9e6b-4b6a-b262-99ebef3291a8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1407 microversion: 2.20 time: 0.227214 Jul 25 23:04:36.149294 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 46/92] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:04:35 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:04:36.149466 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-220b9760-29ac-40e6-98dd-edc4a145583d tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:36.149466 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-220b9760-29ac-40e6-98dd-edc4a145583d tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:36.153086 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-220b9760-29ac-40e6-98dd-edc4a145583d tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:36.153826 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-220b9760-29ac-40e6-98dd-edc4a145583d tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:36.154569 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-220b9760-29ac-40e6-98dd-edc4a145583d tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:36.155003 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-220b9760-29ac-40e6-98dd-edc4a145583d tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:36.289026 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-220b9760-29ac-40e6-98dd-edc4a145583d tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:36.297637 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-220b9760-29ac-40e6-98dd-edc4a145583d tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1314 microversion: 2.1 time: 0.155293 Jul 25 23:04:36.298211 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 47/93] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:36 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:36.607262 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-71847581-b665-43ed-a43d-92c5138d843d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:36.607937 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-71847581-b665-43ed-a43d-92c5138d843d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:36.614103 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-71847581-b665-43ed-a43d-92c5138d843d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:36.614538 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-71847581-b665-43ed-a43d-92c5138d843d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:36.615285 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-71847581-b665-43ed-a43d-92c5138d843d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:36.615707 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-71847581-b665-43ed-a43d-92c5138d843d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:36.810634 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=10 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:36.957726 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-71847581-b665-43ed-a43d-92c5138d843d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:36.966603 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-71847581-b665-43ed-a43d-92c5138d843d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1363 microversion: 2.1 time: 0.364440 Jul 25 23:04:36.967171 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 47/94] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:36 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1363 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:37.163017 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-7e6b3f09-9a21-4576-9cc8-2f6f9d17259e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:37.163626 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-7e6b3f09-9a21-4576-9cc8-2f6f9d17259e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:37.166042 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-bb28e0df-5273-4ef6-b2ce-dfb13c59ecc7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:37.167324 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-bb28e0df-5273-4ef6-b2ce-dfb13c59ecc7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:37.172011 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7e6b3f09-9a21-4576-9cc8-2f6f9d17259e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:37.172732 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7e6b3f09-9a21-4576-9cc8-2f6f9d17259e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:37.173546 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7e6b3f09-9a21-4576-9cc8-2f6f9d17259e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:37.173840 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bb28e0df-5273-4ef6-b2ce-dfb13c59ecc7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:37.173976 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7e6b3f09-9a21-4576-9cc8-2f6f9d17259e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:37.174316 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bb28e0df-5273-4ef6-b2ce-dfb13c59ecc7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:37.175174 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bb28e0df-5273-4ef6-b2ce-dfb13c59ecc7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:37.175607 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bb28e0df-5273-4ef6-b2ce-dfb13c59ecc7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:37.442270 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-7e6b3f09-9a21-4576-9cc8-2f6f9d17259e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:37.452324 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-7e6b3f09-9a21-4576-9cc8-2f6f9d17259e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1321 microversion: 2.1 time: 0.293183 Jul 25 23:04:37.453686 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 48/95] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:37 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:37.459729 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-c890d3c6-e57a-4b04-bc6c-3de74123fc74 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:37.460344 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-c890d3c6-e57a-4b04-bc6c-3de74123fc74 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:37.469467 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c890d3c6-e57a-4b04-bc6c-3de74123fc74 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:37.469909 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c890d3c6-e57a-4b04-bc6c-3de74123fc74 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:37.474201 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c890d3c6-e57a-4b04-bc6c-3de74123fc74 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:37.474201 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c890d3c6-e57a-4b04-bc6c-3de74123fc74 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:37.476148 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-bb28e0df-5273-4ef6-b2ce-dfb13c59ecc7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:37.484878 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-bb28e0df-5273-4ef6-b2ce-dfb13c59ecc7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:37.486408 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-bb28e0df-5273-4ef6-b2ce-dfb13c59ecc7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:37.487510 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-bb28e0df-5273-4ef6-b2ce-dfb13c59ecc7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1407 microversion: 2.20 time: 0.326219 Jul 25 23:04:37.488067 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 48/96] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:04:37 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1407 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:04:37.606202 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-c890d3c6-e57a-4b04-bc6c-3de74123fc74 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:37.614016 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-c890d3c6-e57a-4b04-bc6c-3de74123fc74 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1314 microversion: 2.1 time: 0.159117 Jul 25 23:04:37.614843 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 49/97] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:37 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:37.987792 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-8d2b9cc0-861b-420f-b85e-c2f8544319a1 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:37.988385 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-8d2b9cc0-861b-420f-b85e-c2f8544319a1 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:37.994392 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8d2b9cc0-861b-420f-b85e-c2f8544319a1 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:37.995497 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8d2b9cc0-861b-420f-b85e-c2f8544319a1 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:37.996460 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8d2b9cc0-861b-420f-b85e-c2f8544319a1 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:37.996935 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8d2b9cc0-861b-420f-b85e-c2f8544319a1 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:38.140467 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-8d2b9cc0-861b-420f-b85e-c2f8544319a1 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:38.150281 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-8d2b9cc0-861b-420f-b85e-c2f8544319a1 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1363 microversion: 2.1 time: 0.166226 Jul 25 23:04:38.164766 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 49/98] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:37 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:38.473250 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-aa7260c5-1c58-41bd-aa2e-349ed16b2785 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:38.473850 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-aa7260c5-1c58-41bd-aa2e-349ed16b2785 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:38.480220 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-aa7260c5-1c58-41bd-aa2e-349ed16b2785 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:38.480528 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-aa7260c5-1c58-41bd-aa2e-349ed16b2785 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:38.481564 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-aa7260c5-1c58-41bd-aa2e-349ed16b2785 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:38.482021 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-aa7260c5-1c58-41bd-aa2e-349ed16b2785 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:38.510031 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-ea59ae43-af6b-4ee2-83ff-5839ee4e0416 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:38.512304 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-ea59ae43-af6b-4ee2-83ff-5839ee4e0416 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:38.519190 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ea59ae43-af6b-4ee2-83ff-5839ee4e0416 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:38.520628 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ea59ae43-af6b-4ee2-83ff-5839ee4e0416 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:38.520628 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ea59ae43-af6b-4ee2-83ff-5839ee4e0416 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:38.520831 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ea59ae43-af6b-4ee2-83ff-5839ee4e0416 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:38.820951 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ea59ae43-af6b-4ee2-83ff-5839ee4e0416 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:38.829988 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ea59ae43-af6b-4ee2-83ff-5839ee4e0416 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:38.831698 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ea59ae43-af6b-4ee2-83ff-5839ee4e0416 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:38.832649 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-ea59ae43-af6b-4ee2-83ff-5839ee4e0416 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1407 microversion: 2.20 time: 0.326616 Jul 25 23:04:38.839970 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-aa7260c5-1c58-41bd-aa2e-349ed16b2785 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:38.840263 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 50/99] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:04:38 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1407 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:04:38.849155 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e0d17ad9-6669-4143-b6d0-ad37182dbc81 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:38.855386 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-aa7260c5-1c58-41bd-aa2e-349ed16b2785 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1321 microversion: 2.1 time: 0.385974 Jul 25 23:04:38.856375 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e0d17ad9-6669-4143-b6d0-ad37182dbc81 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:38.856838 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 50/100] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:38 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1321 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:38.862891 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e0d17ad9-6669-4143-b6d0-ad37182dbc81 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:38.863338 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e0d17ad9-6669-4143-b6d0-ad37182dbc81 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:38.864101 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e0d17ad9-6669-4143-b6d0-ad37182dbc81 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:38.864527 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e0d17ad9-6669-4143-b6d0-ad37182dbc81 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:39.172782 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-de2c4de2-5c3b-4e2b-ae45-f29e96a28fdc tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:39.173517 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-de2c4de2-5c3b-4e2b-ae45-f29e96a28fdc tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:39.179714 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-de2c4de2-5c3b-4e2b-ae45-f29e96a28fdc tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:39.182859 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-de2c4de2-5c3b-4e2b-ae45-f29e96a28fdc tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:39.182859 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-de2c4de2-5c3b-4e2b-ae45-f29e96a28fdc tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:39.182859 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-de2c4de2-5c3b-4e2b-ae45-f29e96a28fdc tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:39.316639 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e0d17ad9-6669-4143-b6d0-ad37182dbc81 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:39.325368 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e0d17ad9-6669-4143-b6d0-ad37182dbc81 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1314 microversion: 2.1 time: 0.483941 Jul 25 23:04:39.325932 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 51/101] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:38 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1314 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:39.381286 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-de2c4de2-5c3b-4e2b-ae45-f29e96a28fdc tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:39.390647 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-de2c4de2-5c3b-4e2b-ae45-f29e96a28fdc tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1363 microversion: 2.1 time: 0.221843 Jul 25 23:04:39.391255 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 51/102] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:39 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:04:39.856648 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-2ea696ed-4b1d-4ec9-9deb-b92b9b786dfa tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:39.857390 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-2ea696ed-4b1d-4ec9-9deb-b92b9b786dfa tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:39.864012 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2ea696ed-4b1d-4ec9-9deb-b92b9b786dfa tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:39.864592 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2ea696ed-4b1d-4ec9-9deb-b92b9b786dfa tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:39.865716 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2ea696ed-4b1d-4ec9-9deb-b92b9b786dfa tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:39.866198 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2ea696ed-4b1d-4ec9-9deb-b92b9b786dfa tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:39.875933 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-5736274e-7594-4abf-9af2-6a586c2b16eb tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:39.876640 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-5736274e-7594-4abf-9af2-6a586c2b16eb tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:39.883516 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5736274e-7594-4abf-9af2-6a586c2b16eb tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:39.884054 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5736274e-7594-4abf-9af2-6a586c2b16eb tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:39.884924 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5736274e-7594-4abf-9af2-6a586c2b16eb tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:39.886086 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5736274e-7594-4abf-9af2-6a586c2b16eb tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:40.074889 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-2ea696ed-4b1d-4ec9-9deb-b92b9b786dfa tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:40.085640 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-2ea696ed-4b1d-4ec9-9deb-b92b9b786dfa tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:40.090502 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-2ea696ed-4b1d-4ec9-9deb-b92b9b786dfa tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:40.090502 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-2ea696ed-4b1d-4ec9-9deb-b92b9b786dfa tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1407 microversion: 2.20 time: 0.236288 Jul 25 23:04:40.091624 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 52/103] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:04:39 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:04:40.103343 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-5736274e-7594-4abf-9af2-6a586c2b16eb tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:40.112596 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-5736274e-7594-4abf-9af2-6a586c2b16eb tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1321 microversion: 2.1 time: 0.240510 Jul 25 23:04:40.113194 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 52/104] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:39 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1321 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:04:40.348581 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-34db0c3c-60c4-4427-846f-70d07e65c31d tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:40.349204 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-34db0c3c-60c4-4427-846f-70d07e65c31d tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:40.356302 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-34db0c3c-60c4-4427-846f-70d07e65c31d tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:40.356745 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-34db0c3c-60c4-4427-846f-70d07e65c31d tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:40.357606 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-34db0c3c-60c4-4427-846f-70d07e65c31d tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:40.358029 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-34db0c3c-60c4-4427-846f-70d07e65c31d tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:40.413037 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-34674dd9-7af4-46b8-826c-a5649c11f91c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:40.413673 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-34674dd9-7af4-46b8-826c-a5649c11f91c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:40.420561 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-34674dd9-7af4-46b8-826c-a5649c11f91c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:40.421008 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-34674dd9-7af4-46b8-826c-a5649c11f91c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:40.421808 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-34674dd9-7af4-46b8-826c-a5649c11f91c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:40.422407 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-34674dd9-7af4-46b8-826c-a5649c11f91c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:40.574252 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-34db0c3c-60c4-4427-846f-70d07e65c31d tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:40.583084 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-34db0c3c-60c4-4427-846f-70d07e65c31d tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1314 microversion: 2.1 time: 0.238084 Jul 25 23:04:40.584117 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 53/105] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:40 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:40.607803 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-34674dd9-7af4-46b8-826c-a5649c11f91c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:40.617318 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-34674dd9-7af4-46b8-826c-a5649c11f91c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1363 microversion: 2.1 time: 0.208322 Jul 25 23:04:40.618213 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 53/106] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:40 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:04:41.121348 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-8f926ed8-fab3-413b-a00f-d9bea6c4c383 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:41.122644 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-8f926ed8-fab3-413b-a00f-d9bea6c4c383 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:41.134232 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-eef5ca4a-a8f1-45fb-83d3-bee77abe01d8 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:41.135685 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-eef5ca4a-a8f1-45fb-83d3-bee77abe01d8 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:41.136471 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8f926ed8-fab3-413b-a00f-d9bea6c4c383 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:41.137476 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8f926ed8-fab3-413b-a00f-d9bea6c4c383 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:41.138835 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8f926ed8-fab3-413b-a00f-d9bea6c4c383 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:41.139584 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8f926ed8-fab3-413b-a00f-d9bea6c4c383 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:41.147060 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-eef5ca4a-a8f1-45fb-83d3-bee77abe01d8 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:41.147763 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-eef5ca4a-a8f1-45fb-83d3-bee77abe01d8 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:41.148804 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-eef5ca4a-a8f1-45fb-83d3-bee77abe01d8 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:41.149402 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-eef5ca4a-a8f1-45fb-83d3-bee77abe01d8 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:41.183725 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=100 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:41.434373 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-eef5ca4a-a8f1-45fb-83d3-bee77abe01d8 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:41.441620 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-8f926ed8-fab3-413b-a00f-d9bea6c4c383 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:41.443090 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-eef5ca4a-a8f1-45fb-83d3-bee77abe01d8 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1321 microversion: 2.1 time: 0.312706 Jul 25 23:04:41.457147 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 54/107] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:41 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1321 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:41.466422 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-8f926ed8-fab3-413b-a00f-d9bea6c4c383 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:41.467924 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-8f926ed8-fab3-413b-a00f-d9bea6c4c383 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:41.469150 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-8f926ed8-fab3-413b-a00f-d9bea6c4c383 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1407 microversion: 2.20 time: 0.359596 Jul 25 23:04:41.473211 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 54/108] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:04:41 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1407 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:04:41.604617 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-f9fa6c75-df67-4eda-a2c6-0cdf4b6b272e tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:41.605218 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-f9fa6c75-df67-4eda-a2c6-0cdf4b6b272e tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:41.612113 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f9fa6c75-df67-4eda-a2c6-0cdf4b6b272e tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:41.612655 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f9fa6c75-df67-4eda-a2c6-0cdf4b6b272e tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:41.613622 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f9fa6c75-df67-4eda-a2c6-0cdf4b6b272e tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:41.614571 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f9fa6c75-df67-4eda-a2c6-0cdf4b6b272e tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:41.640058 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-75636f4c-efb5-43b3-9427-659ba6379b1f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:41.641220 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-75636f4c-efb5-43b3-9427-659ba6379b1f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:41.649154 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-75636f4c-efb5-43b3-9427-659ba6379b1f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:41.649774 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-75636f4c-efb5-43b3-9427-659ba6379b1f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:41.650578 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-75636f4c-efb5-43b3-9427-659ba6379b1f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:41.651768 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-75636f4c-efb5-43b3-9427-659ba6379b1f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:41.977393 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-f9fa6c75-df67-4eda-a2c6-0cdf4b6b272e tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:41.987248 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-f9fa6c75-df67-4eda-a2c6-0cdf4b6b272e tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1314 microversion: 2.1 time: 0.387193 Jul 25 23:04:41.988021 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 55/109] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:41 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:42.001994 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-75636f4c-efb5-43b3-9427-659ba6379b1f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:42.007378 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-75636f4c-efb5-43b3-9427-659ba6379b1f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1363 microversion: 2.1 time: 0.372902 Jul 25 23:04:42.015912 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 55/110] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:41 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1363 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:42.472922 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-f101a42f-d2dd-4f03-b8fa-4a40d5d903dd tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:42.473579 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-f101a42f-d2dd-4f03-b8fa-4a40d5d903dd tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:42.480853 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f101a42f-d2dd-4f03-b8fa-4a40d5d903dd tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:42.481341 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f101a42f-d2dd-4f03-b8fa-4a40d5d903dd tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:42.482194 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f101a42f-d2dd-4f03-b8fa-4a40d5d903dd tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:42.482669 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f101a42f-d2dd-4f03-b8fa-4a40d5d903dd tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:42.497661 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-2d495c9d-2709-440a-9fe8-5afb827bbfe6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:42.498257 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-2d495c9d-2709-440a-9fe8-5afb827bbfe6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:42.504734 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2d495c9d-2709-440a-9fe8-5afb827bbfe6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:42.505259 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2d495c9d-2709-440a-9fe8-5afb827bbfe6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:42.518744 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2d495c9d-2709-440a-9fe8-5afb827bbfe6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:42.519096 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2d495c9d-2709-440a-9fe8-5afb827bbfe6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:42.541360 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=100 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:42.805296 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-f101a42f-d2dd-4f03-b8fa-4a40d5d903dd tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:42.816742 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-f101a42f-d2dd-4f03-b8fa-4a40d5d903dd tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1321 microversion: 2.1 time: 0.352607 Jul 25 23:04:42.820641 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 56/111] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:42 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1321 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:04:42.831252 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-6093cf92-5fb8-4c96-a85a-051c06d5278c req-56306159-4aae-43b0-b196-2a5010192fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e78f6354-b88d-45a6-817b-4ef206d07d33", "tag": "b7e5b654-c700-4c79-966e-9953941ea57a"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:04:42.834996 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-2d495c9d-2709-440a-9fe8-5afb827bbfe6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:42.842976 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-6093cf92-5fb8-4c96-a85a-051c06d5278c req-56306159-4aae-43b0-b196-2a5010192fc4 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:42.843688 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-6093cf92-5fb8-4c96-a85a-051c06d5278c req-56306159-4aae-43b0-b196-2a5010192fc4 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:42.844329 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-2d495c9d-2709-440a-9fe8-5afb827bbfe6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:42.846095 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-2d495c9d-2709-440a-9fe8-5afb827bbfe6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:42.847214 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-2d495c9d-2709-440a-9fe8-5afb827bbfe6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1407 microversion: 2.20 time: 0.354618 Jul 25 23:04:42.847765 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 56/112] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:04:42 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1407 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:04:42.858976 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-6093cf92-5fb8-4c96-a85a-051c06d5278c req-56306159-4aae-43b0-b196-2a5010192fc4 service nova] Creating event network-changed:b7e5b654-c700-4c79-966e-9953941ea57a for instance e78f6354-b88d-45a6-817b-4ef206d07d33 on hv-cinder-79760 Jul 25 23:04:42.864652 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-6093cf92-5fb8-4c96-a85a-051c06d5278c req-56306159-4aae-43b0-b196-2a5010192fc4 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042578 Jul 25 23:04:42.865268 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 57/113] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:04:43.009926 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-3e065d91-160b-45fd-8195-8a2516c8cb33 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:43.011138 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-3e065d91-160b-45fd-8195-8a2516c8cb33 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:43.017097 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3e065d91-160b-45fd-8195-8a2516c8cb33 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:43.017651 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3e065d91-160b-45fd-8195-8a2516c8cb33 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:43.018730 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3e065d91-160b-45fd-8195-8a2516c8cb33 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:43.019318 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3e065d91-160b-45fd-8195-8a2516c8cb33 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:43.030540 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-21a574b7-343e-4e9e-af07-9b71b23b44b6 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:43.031327 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-21a574b7-343e-4e9e-af07-9b71b23b44b6 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:43.038356 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-21a574b7-343e-4e9e-af07-9b71b23b44b6 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:43.038753 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-21a574b7-343e-4e9e-af07-9b71b23b44b6 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:43.039673 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-21a574b7-343e-4e9e-af07-9b71b23b44b6 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:43.040191 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-21a574b7-343e-4e9e-af07-9b71b23b44b6 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:43.230136 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-3e065d91-160b-45fd-8195-8a2516c8cb33 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:43.236818 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-21a574b7-343e-4e9e-af07-9b71b23b44b6 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:43.249110 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-21a574b7-343e-4e9e-af07-9b71b23b44b6 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1363 microversion: 2.1 time: 0.223551 Jul 25 23:04:43.249711 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 58/114] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:43 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:04:43.250341 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-3e065d91-160b-45fd-8195-8a2516c8cb33 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1314 microversion: 2.1 time: 0.241281 Jul 25 23:04:43.254031 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 57/115] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:43 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:43.850446 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-5d41fe5e-d6a7-4086-8c44-29d81d59d89f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:43.855888 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-5d41fe5e-d6a7-4086-8c44-29d81d59d89f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:43.871637 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-552ba533-6a99-4653-96da-525f85a257fe tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:43.872806 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-552ba533-6a99-4653-96da-525f85a257fe tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:43.880329 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5d41fe5e-d6a7-4086-8c44-29d81d59d89f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:43.880777 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5d41fe5e-d6a7-4086-8c44-29d81d59d89f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:43.886174 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5d41fe5e-d6a7-4086-8c44-29d81d59d89f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:43.886174 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5d41fe5e-d6a7-4086-8c44-29d81d59d89f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:43.890809 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-552ba533-6a99-4653-96da-525f85a257fe tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:43.891570 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-552ba533-6a99-4653-96da-525f85a257fe tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:43.893045 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-552ba533-6a99-4653-96da-525f85a257fe tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:43.894446 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-552ba533-6a99-4653-96da-525f85a257fe tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:44.188124 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-552ba533-6a99-4653-96da-525f85a257fe tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:44.214861 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-552ba533-6a99-4653-96da-525f85a257fe tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:44.221804 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-552ba533-6a99-4653-96da-525f85a257fe tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:44.228322 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-5d41fe5e-d6a7-4086-8c44-29d81d59d89f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:44.241506 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-552ba533-6a99-4653-96da-525f85a257fe tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1407 microversion: 2.20 time: 0.358904 Jul 25 23:04:44.244273 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 58/116] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:04:43 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1407 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:04:44.245289 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-5d41fe5e-d6a7-4086-8c44-29d81d59d89f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1321 microversion: 2.1 time: 0.404183 Jul 25 23:04:44.255570 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 59/117] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:43 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1321 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:44.284874 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-680039e9-a398-407c-8a23-14a7cdba7bae tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:44.285517 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-680039e9-a398-407c-8a23-14a7cdba7bae tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:44.286198 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-b5ab591b-402f-4bb9-ad2f-fbcbd00f2bfe tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:44.286912 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-b5ab591b-402f-4bb9-ad2f-fbcbd00f2bfe tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:44.295601 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-680039e9-a398-407c-8a23-14a7cdba7bae tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:44.296057 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-680039e9-a398-407c-8a23-14a7cdba7bae tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:44.296838 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-680039e9-a398-407c-8a23-14a7cdba7bae tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:44.297648 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b5ab591b-402f-4bb9-ad2f-fbcbd00f2bfe tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:44.298235 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b5ab591b-402f-4bb9-ad2f-fbcbd00f2bfe tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:44.299180 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b5ab591b-402f-4bb9-ad2f-fbcbd00f2bfe tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:44.299548 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-680039e9-a398-407c-8a23-14a7cdba7bae tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:44.300039 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b5ab591b-402f-4bb9-ad2f-fbcbd00f2bfe tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:44.745652 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-b5ab591b-402f-4bb9-ad2f-fbcbd00f2bfe tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:44.751992 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-680039e9-a398-407c-8a23-14a7cdba7bae tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:44.753829 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-b5ab591b-402f-4bb9-ad2f-fbcbd00f2bfe tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1363 microversion: 2.1 time: 0.471946 Jul 25 23:04:44.768279 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-680039e9-a398-407c-8a23-14a7cdba7bae tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1314 microversion: 2.1 time: 0.478662 Jul 25 23:04:44.768279 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 59/118] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:44 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1314 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:44.772687 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 60/119] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:44 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1363 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:45.269067 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-84e2e6c0-e48e-415b-91dd-8f589020201f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:45.269948 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-d84f406e-1316-4603-9eb7-1f7a4fcb1598 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:45.270566 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-d84f406e-1316-4603-9eb7-1f7a4fcb1598 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:45.271116 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-84e2e6c0-e48e-415b-91dd-8f589020201f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:45.278828 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d84f406e-1316-4603-9eb7-1f7a4fcb1598 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:45.279611 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d84f406e-1316-4603-9eb7-1f7a4fcb1598 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:45.280746 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d84f406e-1316-4603-9eb7-1f7a4fcb1598 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:45.281364 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d84f406e-1316-4603-9eb7-1f7a4fcb1598 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:45.281558 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-84e2e6c0-e48e-415b-91dd-8f589020201f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:45.282005 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-84e2e6c0-e48e-415b-91dd-8f589020201f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:45.283216 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-84e2e6c0-e48e-415b-91dd-8f589020201f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:45.283656 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-84e2e6c0-e48e-415b-91dd-8f589020201f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:45.543553 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-84e2e6c0-e48e-415b-91dd-8f589020201f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:45.566451 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-84e2e6c0-e48e-415b-91dd-8f589020201f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:45.566668 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-d84f406e-1316-4603-9eb7-1f7a4fcb1598 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:45.574536 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-84e2e6c0-e48e-415b-91dd-8f589020201f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:45.575861 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-d84f406e-1316-4603-9eb7-1f7a4fcb1598 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1321 microversion: 2.1 time: 0.311482 Jul 25 23:04:45.576627 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 61/120] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:45 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1321 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:45.577483 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-84e2e6c0-e48e-415b-91dd-8f589020201f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1407 microversion: 2.20 time: 0.313100 Jul 25 23:04:45.578912 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 60/121] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:04:45 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1407 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:04:45.779387 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-f321732d-3d4d-4951-86af-2dafbcde3e5c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:45.780069 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-f321732d-3d4d-4951-86af-2dafbcde3e5c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:45.781313 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-481a63b6-e229-4967-a436-5d5d43f76d24 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:45.782427 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-481a63b6-e229-4967-a436-5d5d43f76d24 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:45.789315 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-481a63b6-e229-4967-a436-5d5d43f76d24 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:45.790089 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-481a63b6-e229-4967-a436-5d5d43f76d24 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:45.792019 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-481a63b6-e229-4967-a436-5d5d43f76d24 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:45.792019 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-481a63b6-e229-4967-a436-5d5d43f76d24 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:45.794132 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f321732d-3d4d-4951-86af-2dafbcde3e5c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:45.794586 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f321732d-3d4d-4951-86af-2dafbcde3e5c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:45.796831 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f321732d-3d4d-4951-86af-2dafbcde3e5c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:45.797316 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f321732d-3d4d-4951-86af-2dafbcde3e5c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:46.092975 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-481a63b6-e229-4967-a436-5d5d43f76d24 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:46.096331 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-f321732d-3d4d-4951-86af-2dafbcde3e5c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:46.100724 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-481a63b6-e229-4967-a436-5d5d43f76d24 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1314 microversion: 2.1 time: 0.324041 Jul 25 23:04:46.101797 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 61/122] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:45 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:04:46.108037 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-f321732d-3d4d-4951-86af-2dafbcde3e5c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1363 microversion: 2.1 time: 0.335140 Jul 25 23:04:46.110711 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 62/123] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:45 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1363 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:46.175615 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-581b095b-cc3a-4d1a-9b0b-9ca3fda48ebb req-693b5b73-06a6-450e-9acf-d28ac64832b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06fcf0b9-57d3-4abb-8b39-cf03d104f2a8", "name": "network-vif-plugged", "status": "completed", "tag": "3362c499-c419-49ff-9af6-1d14b8fe4fcb"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:04:46.187200 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-581b095b-cc3a-4d1a-9b0b-9ca3fda48ebb req-693b5b73-06a6-450e-9acf-d28ac64832b9 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:46.187853 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-581b095b-cc3a-4d1a-9b0b-9ca3fda48ebb req-693b5b73-06a6-450e-9acf-d28ac64832b9 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:46.204656 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-581b095b-cc3a-4d1a-9b0b-9ca3fda48ebb req-693b5b73-06a6-450e-9acf-d28ac64832b9 service nova] Creating event network-vif-plugged:3362c499-c419-49ff-9af6-1d14b8fe4fcb for instance 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 on hv-cinder-79760 Jul 25 23:04:46.209745 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-581b095b-cc3a-4d1a-9b0b-9ca3fda48ebb req-693b5b73-06a6-450e-9acf-d28ac64832b9 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107038 Jul 25 23:04:46.213609 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 62/124] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:04:46.603795 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-72608133-cdc4-4773-83a1-0b0b6494ec03 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:46.605159 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-72608133-cdc4-4773-83a1-0b0b6494ec03 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:46.607810 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a265cc87-31f3-4360-a352-dcd334639f24 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:46.609255 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a265cc87-31f3-4360-a352-dcd334639f24 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:46.623108 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-72608133-cdc4-4773-83a1-0b0b6494ec03 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:46.623739 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-72608133-cdc4-4773-83a1-0b0b6494ec03 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:46.623994 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a265cc87-31f3-4360-a352-dcd334639f24 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:46.624450 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a265cc87-31f3-4360-a352-dcd334639f24 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:46.625272 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a265cc87-31f3-4360-a352-dcd334639f24 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:46.626190 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-72608133-cdc4-4773-83a1-0b0b6494ec03 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:46.626629 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a265cc87-31f3-4360-a352-dcd334639f24 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:46.627801 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-72608133-cdc4-4773-83a1-0b0b6494ec03 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:46.865942 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a265cc87-31f3-4360-a352-dcd334639f24 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:46.878260 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a265cc87-31f3-4360-a352-dcd334639f24 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1321 microversion: 2.1 time: 0.279934 Jul 25 23:04:46.878844 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 63/125] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:46 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1321 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:46.912398 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-72608133-cdc4-4773-83a1-0b0b6494ec03 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:46.920288 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-72608133-cdc4-4773-83a1-0b0b6494ec03 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:46.922050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-72608133-cdc4-4773-83a1-0b0b6494ec03 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:46.923147 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-72608133-cdc4-4773-83a1-0b0b6494ec03 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1407 microversion: 2.20 time: 0.326691 Jul 25 23:04:46.925256 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 63/126] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:04:46 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1407 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:04:47.129355 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f1749868-3937-4422-809d-d33a5d10f3a0 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:47.129989 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f1749868-3937-4422-809d-d33a5d10f3a0 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:47.131433 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-81968a65-98d5-4f38-b161-2aba865bdce8 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:47.132073 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-81968a65-98d5-4f38-b161-2aba865bdce8 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:47.137154 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f1749868-3937-4422-809d-d33a5d10f3a0 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:47.137602 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f1749868-3937-4422-809d-d33a5d10f3a0 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:47.138357 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f1749868-3937-4422-809d-d33a5d10f3a0 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:47.138782 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f1749868-3937-4422-809d-d33a5d10f3a0 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:47.138912 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-81968a65-98d5-4f38-b161-2aba865bdce8 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:47.139310 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-81968a65-98d5-4f38-b161-2aba865bdce8 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:47.140546 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-81968a65-98d5-4f38-b161-2aba865bdce8 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:47.141438 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-81968a65-98d5-4f38-b161-2aba865bdce8 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:47.336451 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-81968a65-98d5-4f38-b161-2aba865bdce8 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:47.345085 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-81968a65-98d5-4f38-b161-2aba865bdce8 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1363 microversion: 2.1 time: 0.217201 Jul 25 23:04:47.346631 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 64/127] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:47 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:04:47.442319 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f1749868-3937-4422-809d-d33a5d10f3a0 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:47.450788 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f1749868-3937-4422-809d-d33a5d10f3a0 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1314 microversion: 2.1 time: 0.325325 Jul 25 23:04:47.451382 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 64/128] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:47 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:47.898679 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-16a3db8e-270b-4477-b3d2-7b4bf87e6fa0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:47.899210 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-16a3db8e-270b-4477-b3d2-7b4bf87e6fa0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:47.909252 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-16a3db8e-270b-4477-b3d2-7b4bf87e6fa0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:47.909933 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-16a3db8e-270b-4477-b3d2-7b4bf87e6fa0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:47.910840 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-16a3db8e-270b-4477-b3d2-7b4bf87e6fa0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:47.911406 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-16a3db8e-270b-4477-b3d2-7b4bf87e6fa0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:47.950105 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a165cd47-00ea-48de-8af1-ce780284c999 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:47.950988 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a165cd47-00ea-48de-8af1-ce780284c999 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:47.957421 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a165cd47-00ea-48de-8af1-ce780284c999 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:47.957866 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a165cd47-00ea-48de-8af1-ce780284c999 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:47.958738 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a165cd47-00ea-48de-8af1-ce780284c999 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:47.959173 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a165cd47-00ea-48de-8af1-ce780284c999 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:48.209826 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-16a3db8e-270b-4477-b3d2-7b4bf87e6fa0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:48.217965 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-16a3db8e-270b-4477-b3d2-7b4bf87e6fa0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1321 microversion: 2.1 time: 0.323072 Jul 25 23:04:48.218550 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 65/129] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:47 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1321 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:48.224271 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-c477f500-7074-4c3b-8b0a-f291b852c9fe req-3094f7fc-7b5b-403c-8300-fea28b38d3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f79f5efc-af32-4b3a-975a-aef5b386752f", "name": "network-vif-plugged", "status": "completed", "tag": "adb509d8-1477-472c-bb38-e69e5cdd5c19"}, {"server_uuid": "be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad", "name": "network-vif-plugged", "status": "completed", "tag": "2dda7df4-b839-4b39-8a4c-076a67b464e7"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:04:48.233504 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a165cd47-00ea-48de-8af1-ce780284c999 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:48.236385 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-c477f500-7074-4c3b-8b0a-f291b852c9fe req-3094f7fc-7b5b-403c-8300-fea28b38d3a4 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:48.237068 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-c477f500-7074-4c3b-8b0a-f291b852c9fe req-3094f7fc-7b5b-403c-8300-fea28b38d3a4 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:48.245336 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a165cd47-00ea-48de-8af1-ce780284c999 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:48.246918 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a165cd47-00ea-48de-8af1-ce780284c999 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:48.248040 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a165cd47-00ea-48de-8af1-ce780284c999 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1407 microversion: 2.20 time: 0.304353 Jul 25 23:04:48.248584 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 65/130] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:04:47 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1407 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:04:48.252096 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-c477f500-7074-4c3b-8b0a-f291b852c9fe req-3094f7fc-7b5b-403c-8300-fea28b38d3a4 service nova] Creating event network-vif-plugged:adb509d8-1477-472c-bb38-e69e5cdd5c19 for instance f79f5efc-af32-4b3a-975a-aef5b386752f on hv-cinder-79760 Jul 25 23:04:48.252595 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-c477f500-7074-4c3b-8b0a-f291b852c9fe req-3094f7fc-7b5b-403c-8300-fea28b38d3a4 service nova] Creating event network-vif-plugged:2dda7df4-b839-4b39-8a4c-076a67b464e7 for instance be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad on hv-cinder-79760 Jul 25 23:04:48.262376 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-c477f500-7074-4c3b-8b0a-f291b852c9fe req-3094f7fc-7b5b-403c-8300-fea28b38d3a4 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041671 Jul 25 23:04:48.263436 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 66/131] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 23:04:48.367344 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-bf2d86da-d451-4617-86c3-05d16bbcab79 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:48.367962 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-bf2d86da-d451-4617-86c3-05d16bbcab79 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:48.375023 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bf2d86da-d451-4617-86c3-05d16bbcab79 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:48.381756 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bf2d86da-d451-4617-86c3-05d16bbcab79 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:48.381756 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bf2d86da-d451-4617-86c3-05d16bbcab79 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:48.381756 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bf2d86da-d451-4617-86c3-05d16bbcab79 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:48.473050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-2dfbb165-a565-4b17-bbf9-75e715dafe2c tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:48.473784 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-2dfbb165-a565-4b17-bbf9-75e715dafe2c tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:48.480969 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2dfbb165-a565-4b17-bbf9-75e715dafe2c tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:48.481458 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2dfbb165-a565-4b17-bbf9-75e715dafe2c tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:48.482227 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2dfbb165-a565-4b17-bbf9-75e715dafe2c tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:48.482655 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2dfbb165-a565-4b17-bbf9-75e715dafe2c tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:48.807684 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-bf2d86da-d451-4617-86c3-05d16bbcab79 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:48.815338 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-bf2d86da-d451-4617-86c3-05d16bbcab79 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1363 microversion: 2.1 time: 0.452137 Jul 25 23:04:48.816610 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 66/132] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:48 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1363 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:48.852706 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-2dfbb165-a565-4b17-bbf9-75e715dafe2c tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:48.867364 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-2dfbb165-a565-4b17-bbf9-75e715dafe2c tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1314 microversion: 2.1 time: 0.398920 Jul 25 23:04:48.867937 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 67/133] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:48 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:04:49.239956 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-bc1be8cf-6876-4030-8549-40a8eebbffbe tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:49.240573 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-bc1be8cf-6876-4030-8549-40a8eebbffbe tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:49.249376 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bc1be8cf-6876-4030-8549-40a8eebbffbe tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:49.250249 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bc1be8cf-6876-4030-8549-40a8eebbffbe tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:49.251245 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bc1be8cf-6876-4030-8549-40a8eebbffbe tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:49.252195 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bc1be8cf-6876-4030-8549-40a8eebbffbe tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:49.271697 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-f278cf98-cc1b-42e2-a066-c6d5618a78bb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:49.272741 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-f278cf98-cc1b-42e2-a066-c6d5618a78bb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:49.286074 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f278cf98-cc1b-42e2-a066-c6d5618a78bb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:49.287813 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f278cf98-cc1b-42e2-a066-c6d5618a78bb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:49.288925 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f278cf98-cc1b-42e2-a066-c6d5618a78bb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:49.289512 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f278cf98-cc1b-42e2-a066-c6d5618a78bb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:49.511733 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-bc1be8cf-6876-4030-8549-40a8eebbffbe tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:49.520803 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-bc1be8cf-6876-4030-8549-40a8eebbffbe tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1321 microversion: 2.1 time: 0.284805 Jul 25 23:04:49.521426 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-f278cf98-cc1b-42e2-a066-c6d5618a78bb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:49.521569 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 67/134] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:49 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1321 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:49.532561 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-f278cf98-cc1b-42e2-a066-c6d5618a78bb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:49.537100 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-f278cf98-cc1b-42e2-a066-c6d5618a78bb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:49.539753 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-f278cf98-cc1b-42e2-a066-c6d5618a78bb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1407 microversion: 2.20 time: 0.272148 Jul 25 23:04:49.540607 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 68/135] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:04:49 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1407 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:04:49.839885 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-705fb44b-c1d9-4e30-81d0-e31e785d3f83 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:49.843335 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-705fb44b-c1d9-4e30-81d0-e31e785d3f83 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:49.848055 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-705fb44b-c1d9-4e30-81d0-e31e785d3f83 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:49.848555 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-705fb44b-c1d9-4e30-81d0-e31e785d3f83 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:49.849558 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-705fb44b-c1d9-4e30-81d0-e31e785d3f83 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:49.850773 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-705fb44b-c1d9-4e30-81d0-e31e785d3f83 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:49.888769 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-b54d32f8-775a-49b6-946a-1f413c828c0f tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:49.889410 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-b54d32f8-775a-49b6-946a-1f413c828c0f tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:49.896105 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b54d32f8-775a-49b6-946a-1f413c828c0f tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:49.896776 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b54d32f8-775a-49b6-946a-1f413c828c0f tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:49.904740 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b54d32f8-775a-49b6-946a-1f413c828c0f tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:49.904740 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b54d32f8-775a-49b6-946a-1f413c828c0f tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:50.128092 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-705fb44b-c1d9-4e30-81d0-e31e785d3f83 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:50.139787 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-705fb44b-c1d9-4e30-81d0-e31e785d3f83 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1363 microversion: 2.1 time: 0.306116 Jul 25 23:04:50.140386 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 68/136] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:49 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1363 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:50.143873 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-b54d32f8-775a-49b6-946a-1f413c828c0f tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:50.153585 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-b54d32f8-775a-49b6-946a-1f413c828c0f tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1314 microversion: 2.1 time: 0.269113 Jul 25 23:04:50.154390 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 69/137] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:49 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:04:50.542741 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-66a8a728-5294-41b4-b59e-393ee7ffcb9e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:50.543351 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-66a8a728-5294-41b4-b59e-393ee7ffcb9e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:50.549703 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-66a8a728-5294-41b4-b59e-393ee7ffcb9e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:50.550215 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-66a8a728-5294-41b4-b59e-393ee7ffcb9e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:50.551411 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-66a8a728-5294-41b4-b59e-393ee7ffcb9e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:50.551877 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-66a8a728-5294-41b4-b59e-393ee7ffcb9e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:50.563885 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-4269662d-0b6f-4173-b14f-a5517d72be0c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:50.564482 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-4269662d-0b6f-4173-b14f-a5517d72be0c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:50.573549 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4269662d-0b6f-4173-b14f-a5517d72be0c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:50.574535 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4269662d-0b6f-4173-b14f-a5517d72be0c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:50.577677 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4269662d-0b6f-4173-b14f-a5517d72be0c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:50.578706 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4269662d-0b6f-4173-b14f-a5517d72be0c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:50.764099 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-66a8a728-5294-41b4-b59e-393ee7ffcb9e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:50.774463 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-66a8a728-5294-41b4-b59e-393ee7ffcb9e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1321 microversion: 2.1 time: 0.234373 Jul 25 23:04:50.775058 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 69/138] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:50 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1321 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:50.800478 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-4269662d-0b6f-4173-b14f-a5517d72be0c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:50.811186 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-4269662d-0b6f-4173-b14f-a5517d72be0c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:50.813390 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-4269662d-0b6f-4173-b14f-a5517d72be0c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:50.815201 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-4269662d-0b6f-4173-b14f-a5517d72be0c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1407 microversion: 2.20 time: 0.254993 Jul 25 23:04:50.816209 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 70/139] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:04:50 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:04:51.165462 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6b1b40f3-1075-4bf8-ae74-d3c26f671a91 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:51.166651 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6b1b40f3-1075-4bf8-ae74-d3c26f671a91 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:51.173449 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6b1b40f3-1075-4bf8-ae74-d3c26f671a91 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:51.173882 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6b1b40f3-1075-4bf8-ae74-d3c26f671a91 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:51.175510 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6b1b40f3-1075-4bf8-ae74-d3c26f671a91 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:51.175510 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6b1b40f3-1075-4bf8-ae74-d3c26f671a91 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:51.176570 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-20b4a1b4-3e26-4f41-9e6b-73a65d235d8f tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:51.177399 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-20b4a1b4-3e26-4f41-9e6b-73a65d235d8f tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:51.185300 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-20b4a1b4-3e26-4f41-9e6b-73a65d235d8f tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:51.185826 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-20b4a1b4-3e26-4f41-9e6b-73a65d235d8f tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:51.186662 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-20b4a1b4-3e26-4f41-9e6b-73a65d235d8f tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:51.187276 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-20b4a1b4-3e26-4f41-9e6b-73a65d235d8f tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:51.500713 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6b1b40f3-1075-4bf8-ae74-d3c26f671a91 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:51.507082 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-20b4a1b4-3e26-4f41-9e6b-73a65d235d8f tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:51.511004 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6b1b40f3-1075-4bf8-ae74-d3c26f671a91 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1363 microversion: 2.1 time: 0.350365 Jul 25 23:04:51.517042 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-20b4a1b4-3e26-4f41-9e6b-73a65d235d8f tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1314 microversion: 2.1 time: 0.344885 Jul 25 23:04:51.518971 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 71/140] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:51 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:04:51.521826 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 70/141] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:51 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1363 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:51.796593 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-f99105d6-5efc-4189-8286-fc27be8edcb9 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:51.797469 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-f99105d6-5efc-4189-8286-fc27be8edcb9 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:51.805140 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f99105d6-5efc-4189-8286-fc27be8edcb9 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:51.805606 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f99105d6-5efc-4189-8286-fc27be8edcb9 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:51.806378 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f99105d6-5efc-4189-8286-fc27be8edcb9 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:51.807454 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f99105d6-5efc-4189-8286-fc27be8edcb9 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:51.811983 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=100 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:51.839602 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a91189dc-3302-43bb-a446-8d80bdac6307 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:51.846105 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a91189dc-3302-43bb-a446-8d80bdac6307 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:51.860004 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a91189dc-3302-43bb-a446-8d80bdac6307 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:51.863668 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a91189dc-3302-43bb-a446-8d80bdac6307 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:51.867479 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a91189dc-3302-43bb-a446-8d80bdac6307 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:51.868399 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a91189dc-3302-43bb-a446-8d80bdac6307 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:52.076192 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-f99105d6-5efc-4189-8286-fc27be8edcb9 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:52.087048 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-f99105d6-5efc-4189-8286-fc27be8edcb9 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1321 microversion: 2.1 time: 0.294714 Jul 25 23:04:52.087436 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a91189dc-3302-43bb-a446-8d80bdac6307 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:52.097547 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 72/142] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:51 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1321 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:52.097679 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a91189dc-3302-43bb-a446-8d80bdac6307 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:52.098463 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a91189dc-3302-43bb-a446-8d80bdac6307 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:52.099609 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a91189dc-3302-43bb-a446-8d80bdac6307 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1407 microversion: 2.20 time: 0.264225 Jul 25 23:04:52.100309 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 71/143] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:04:51 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:04:52.533590 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-fb2d0ff2-6a9b-4044-9cd7-9d2a63132a03 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:52.534204 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-fb2d0ff2-6a9b-4044-9cd7-9d2a63132a03 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:52.541810 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-fb2d0ff2-6a9b-4044-9cd7-9d2a63132a03 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:52.542322 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-fb2d0ff2-6a9b-4044-9cd7-9d2a63132a03 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:52.543185 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c5c3f8ca-bd2e-4350-8a62-50df988c20f6 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:52.543360 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-fb2d0ff2-6a9b-4044-9cd7-9d2a63132a03 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:52.543606 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-fb2d0ff2-6a9b-4044-9cd7-9d2a63132a03 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:52.543799 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c5c3f8ca-bd2e-4350-8a62-50df988c20f6 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:52.550105 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c5c3f8ca-bd2e-4350-8a62-50df988c20f6 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:52.550679 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c5c3f8ca-bd2e-4350-8a62-50df988c20f6 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:52.557462 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c5c3f8ca-bd2e-4350-8a62-50df988c20f6 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:52.557462 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c5c3f8ca-bd2e-4350-8a62-50df988c20f6 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:52.750743 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-fb2d0ff2-6a9b-4044-9cd7-9d2a63132a03 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:52.750848 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c5c3f8ca-bd2e-4350-8a62-50df988c20f6 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:52.754180 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-fb2d0ff2-6a9b-4044-9cd7-9d2a63132a03 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1363 microversion: 2.1 time: 0.224634 Jul 25 23:04:52.754750 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 73/144] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:52 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:04:52.757795 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c5c3f8ca-bd2e-4350-8a62-50df988c20f6 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1501 microversion: 2.1 time: 0.221203 Jul 25 23:04:52.758514 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 72/145] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:52 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1501 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:04:53.108438 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-9f960898-6610-4701-be50-8e212a4fe00f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:53.110096 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-9f960898-6610-4701-be50-8e212a4fe00f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:53.122070 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9f960898-6610-4701-be50-8e212a4fe00f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:53.134108 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-1dec857a-c0c4-46b6-9cf7-9b305c14fc55 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:53.134108 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-1dec857a-c0c4-46b6-9cf7-9b305c14fc55 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:53.139764 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9f960898-6610-4701-be50-8e212a4fe00f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:53.142809 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9f960898-6610-4701-be50-8e212a4fe00f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:53.144171 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9f960898-6610-4701-be50-8e212a4fe00f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:53.145403 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1dec857a-c0c4-46b6-9cf7-9b305c14fc55 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:53.148558 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1dec857a-c0c4-46b6-9cf7-9b305c14fc55 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:53.149634 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1dec857a-c0c4-46b6-9cf7-9b305c14fc55 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:53.152466 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1dec857a-c0c4-46b6-9cf7-9b305c14fc55 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:53.394138 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-9f960898-6610-4701-be50-8e212a4fe00f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:53.402782 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-9f960898-6610-4701-be50-8e212a4fe00f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1321 microversion: 2.1 time: 0.298574 Jul 25 23:04:53.403933 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 74/146] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:53 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1321 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:53.482043 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-1dec857a-c0c4-46b6-9cf7-9b305c14fc55 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:53.487596 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=100 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:53.499344 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-1dec857a-c0c4-46b6-9cf7-9b305c14fc55 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:53.501452 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-1dec857a-c0c4-46b6-9cf7-9b305c14fc55 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:53.502777 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-1dec857a-c0c4-46b6-9cf7-9b305c14fc55 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1407 microversion: 2.20 time: 0.377635 Jul 25 23:04:53.503747 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 73/147] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:04:53 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1407 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:04:53.640700 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-6a3c891e-82bb-4937-9a43-3412dca4b3b6 req-81a6177d-55fb-4fc6-8475-594d741ad837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6efbf144-c03b-44d4-ad8f-0382560ed59d", "name": "network-vif-plugged", "status": "completed", "tag": "0d5cf52c-9ff5-4944-b3a7-c07d730ee932"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:04:53.650786 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-6a3c891e-82bb-4937-9a43-3412dca4b3b6 req-81a6177d-55fb-4fc6-8475-594d741ad837 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:53.651201 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-6a3c891e-82bb-4937-9a43-3412dca4b3b6 req-81a6177d-55fb-4fc6-8475-594d741ad837 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:53.663221 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-6a3c891e-82bb-4937-9a43-3412dca4b3b6 req-81a6177d-55fb-4fc6-8475-594d741ad837 service nova] Creating event network-vif-plugged:0d5cf52c-9ff5-4944-b3a7-c07d730ee932 for instance 6efbf144-c03b-44d4-ad8f-0382560ed59d on hv-cinder-79760 Jul 25 23:04:53.668998 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-6a3c891e-82bb-4937-9a43-3412dca4b3b6 req-81a6177d-55fb-4fc6-8475-594d741ad837 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031884 Jul 25 23:04:53.669644 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 75/148] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 23:04:53.776116 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-49bebd80-1c0d-4527-b229-d16fe459514b tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:53.776608 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-49bebd80-1c0d-4527-b229-d16fe459514b tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:53.783497 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-49bebd80-1c0d-4527-b229-d16fe459514b tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:53.783804 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-49bebd80-1c0d-4527-b229-d16fe459514b tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:53.784568 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-49bebd80-1c0d-4527-b229-d16fe459514b tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:53.785109 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-49bebd80-1c0d-4527-b229-d16fe459514b tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:53.926486 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-49bebd80-1c0d-4527-b229-d16fe459514b tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:53.934488 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-49bebd80-1c0d-4527-b229-d16fe459514b tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1363 microversion: 2.1 time: 0.162874 Jul 25 23:04:53.935144 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 74/149] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:53 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:54.425930 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-7b13c6e7-b843-4eaa-b836-1da90f50e79e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:54.426671 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-7b13c6e7-b843-4eaa-b836-1da90f50e79e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:54.433226 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7b13c6e7-b843-4eaa-b836-1da90f50e79e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:54.433751 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7b13c6e7-b843-4eaa-b836-1da90f50e79e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:54.434432 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7b13c6e7-b843-4eaa-b836-1da90f50e79e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:54.434916 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7b13c6e7-b843-4eaa-b836-1da90f50e79e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:54.528936 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6d1a3edb-b8e5-4feb-8105-6fd58302ad0d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:54.529628 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6d1a3edb-b8e5-4feb-8105-6fd58302ad0d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:54.537150 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6d1a3edb-b8e5-4feb-8105-6fd58302ad0d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:54.537586 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6d1a3edb-b8e5-4feb-8105-6fd58302ad0d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:54.538540 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6d1a3edb-b8e5-4feb-8105-6fd58302ad0d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:54.539161 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6d1a3edb-b8e5-4feb-8105-6fd58302ad0d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:54.579508 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-7b13c6e7-b843-4eaa-b836-1da90f50e79e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:54.587053 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-7b13c6e7-b843-4eaa-b836-1da90f50e79e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1321 microversion: 2.1 time: 0.165456 Jul 25 23:04:54.587649 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 76/150] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:54 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:54.680912 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6d1a3edb-b8e5-4feb-8105-6fd58302ad0d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:54.689096 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6d1a3edb-b8e5-4feb-8105-6fd58302ad0d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:54.690656 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6d1a3edb-b8e5-4feb-8105-6fd58302ad0d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:54.691755 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6d1a3edb-b8e5-4feb-8105-6fd58302ad0d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1407 microversion: 2.20 time: 0.167806 Jul 25 23:04:54.692319 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 75/151] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:04:54 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:04:54.955925 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-682a23ab-7c9a-4925-ab54-0aa037a23fa8 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:54.956518 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-682a23ab-7c9a-4925-ab54-0aa037a23fa8 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:54.964258 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-682a23ab-7c9a-4925-ab54-0aa037a23fa8 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:54.964699 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-682a23ab-7c9a-4925-ab54-0aa037a23fa8 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:54.965581 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-682a23ab-7c9a-4925-ab54-0aa037a23fa8 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:54.966343 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-682a23ab-7c9a-4925-ab54-0aa037a23fa8 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:55.100682 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-682a23ab-7c9a-4925-ab54-0aa037a23fa8 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:55.109209 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-682a23ab-7c9a-4925-ab54-0aa037a23fa8 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1363 microversion: 2.1 time: 0.156693 Jul 25 23:04:55.109555 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 77/152] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:54 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:55.607915 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4b875c3e-4f3a-4f0c-9910-ec6c272d6617 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:55.608513 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4b875c3e-4f3a-4f0c-9910-ec6c272d6617 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:55.614684 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4b875c3e-4f3a-4f0c-9910-ec6c272d6617 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:55.615132 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4b875c3e-4f3a-4f0c-9910-ec6c272d6617 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:55.615889 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4b875c3e-4f3a-4f0c-9910-ec6c272d6617 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:55.623037 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4b875c3e-4f3a-4f0c-9910-ec6c272d6617 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:55.714399 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-ea1e29e6-9e66-4ce2-926f-6a58a6c2cf04 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:55.715090 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-ea1e29e6-9e66-4ce2-926f-6a58a6c2cf04 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:55.721373 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ea1e29e6-9e66-4ce2-926f-6a58a6c2cf04 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:55.721902 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ea1e29e6-9e66-4ce2-926f-6a58a6c2cf04 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:55.722691 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ea1e29e6-9e66-4ce2-926f-6a58a6c2cf04 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:55.723122 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ea1e29e6-9e66-4ce2-926f-6a58a6c2cf04 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:55.752974 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4b875c3e-4f3a-4f0c-9910-ec6c272d6617 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:55.760503 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4b875c3e-4f3a-4f0c-9910-ec6c272d6617 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1321 microversion: 2.1 time: 0.156556 Jul 25 23:04:55.761082 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 76/153] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:55 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:55.861525 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-ea1e29e6-9e66-4ce2-926f-6a58a6c2cf04 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:55.870475 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-ea1e29e6-9e66-4ce2-926f-6a58a6c2cf04 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:55.872040 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-ea1e29e6-9e66-4ce2-926f-6a58a6c2cf04 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:55.873276 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-ea1e29e6-9e66-4ce2-926f-6a58a6c2cf04 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1407 microversion: 2.20 time: 0.162722 Jul 25 23:04:55.873773 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 78/154] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:04:55 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:04:56.129910 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0d5b4273-403b-4129-a032-0996ba1f6ead tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:56.130461 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-0d5b4273-403b-4129-a032-0996ba1f6ead tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:56.136603 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0d5b4273-403b-4129-a032-0996ba1f6ead tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:56.137048 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0d5b4273-403b-4129-a032-0996ba1f6ead tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:56.137838 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0d5b4273-403b-4129-a032-0996ba1f6ead tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:56.138269 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0d5b4273-403b-4129-a032-0996ba1f6ead tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:56.273250 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-0d5b4273-403b-4129-a032-0996ba1f6ead tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:56.283067 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-0d5b4273-403b-4129-a032-0996ba1f6ead tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1363 microversion: 2.1 time: 0.156959 Jul 25 23:04:56.283652 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 77/155] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:56 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:56.782427 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-ef95d097-82e7-45a4-a94c-b2fac83922fe tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:56.783024 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-ef95d097-82e7-45a4-a94c-b2fac83922fe tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:56.789149 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ef95d097-82e7-45a4-a94c-b2fac83922fe tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:56.794286 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ef95d097-82e7-45a4-a94c-b2fac83922fe tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:56.794286 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ef95d097-82e7-45a4-a94c-b2fac83922fe tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:56.794286 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ef95d097-82e7-45a4-a94c-b2fac83922fe tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:56.896126 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-894dfeed-ae1e-44e6-a07a-1eaa7770551f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:56.896760 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-894dfeed-ae1e-44e6-a07a-1eaa7770551f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:56.903531 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-894dfeed-ae1e-44e6-a07a-1eaa7770551f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:56.904095 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-894dfeed-ae1e-44e6-a07a-1eaa7770551f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:56.904907 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-894dfeed-ae1e-44e6-a07a-1eaa7770551f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:56.905419 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-894dfeed-ae1e-44e6-a07a-1eaa7770551f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:56.940699 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-ef95d097-82e7-45a4-a94c-b2fac83922fe tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:56.950130 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-ef95d097-82e7-45a4-a94c-b2fac83922fe tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1321 microversion: 2.1 time: 0.171855 Jul 25 23:04:56.950745 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 79/156] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:56 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1321 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:04:57.041091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-894dfeed-ae1e-44e6-a07a-1eaa7770551f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:57.048971 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-894dfeed-ae1e-44e6-a07a-1eaa7770551f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:57.050467 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-894dfeed-ae1e-44e6-a07a-1eaa7770551f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:57.051550 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-894dfeed-ae1e-44e6-a07a-1eaa7770551f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1407 microversion: 2.20 time: 0.159338 Jul 25 23:04:57.052104 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 78/157] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:04:56 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:04:57.148322 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-54dc7488-5014-4437-af69-d9104e15d8cd tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4a8ae989-b9d7-43cb-a47e-4c54fcf13043"}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:04:57.151165 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-54dc7488-5014-4437-af69-d9104e15d8cd tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:57.157844 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-54dc7488-5014-4437-af69-d9104e15d8cd tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:57.158277 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-54dc7488-5014-4437-af69-d9104e15d8cd tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:57.159040 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-54dc7488-5014-4437-af69-d9104e15d8cd tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:57.159443 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-54dc7488-5014-4437-af69-d9104e15d8cd tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:57.304478 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-77c19c6e-633c-4200-9717-fff1d373e609 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:57.305083 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-77c19c6e-633c-4200-9717-fff1d373e609 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:57.312444 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-77c19c6e-633c-4200-9717-fff1d373e609 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:57.312886 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-77c19c6e-633c-4200-9717-fff1d373e609 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:57.313883 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-77c19c6e-633c-4200-9717-fff1d373e609 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:57.314315 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-77c19c6e-633c-4200-9717-fff1d373e609 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:57.478853 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-77c19c6e-633c-4200-9717-fff1d373e609 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:57.495110 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-77c19c6e-633c-4200-9717-fff1d373e609 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1363 microversion: 2.1 time: 0.193935 Jul 25 23:04:57.505317 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 79/158] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:57 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:04:57.970090 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d23d7baf-320c-4f3f-a092-3961b3288afd tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:57.970746 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-d23d7baf-320c-4f3f-a092-3961b3288afd tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:57.977033 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d23d7baf-320c-4f3f-a092-3961b3288afd tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:57.977497 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d23d7baf-320c-4f3f-a092-3961b3288afd tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:57.978351 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d23d7baf-320c-4f3f-a092-3961b3288afd tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:57.978874 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d23d7baf-320c-4f3f-a092-3961b3288afd tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:58.136586 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-d23d7baf-320c-4f3f-a092-3961b3288afd tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:58.175394 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-d23d7baf-320c-4f3f-a092-3961b3288afd tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1321 microversion: 2.1 time: 0.208761 Jul 25 23:04:58.176281 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 80/159] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:57 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:04:58.201153 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6365fe7a-9ec1-408c-9e6f-5991a05a0990 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:58.201853 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6365fe7a-9ec1-408c-9e6f-5991a05a0990 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:58.213970 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6365fe7a-9ec1-408c-9e6f-5991a05a0990 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:58.214436 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6365fe7a-9ec1-408c-9e6f-5991a05a0990 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:58.215531 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6365fe7a-9ec1-408c-9e6f-5991a05a0990 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:58.215636 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6365fe7a-9ec1-408c-9e6f-5991a05a0990 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:58.386971 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6365fe7a-9ec1-408c-9e6f-5991a05a0990 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:58.395086 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6365fe7a-9ec1-408c-9e6f-5991a05a0990 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:58.396761 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6365fe7a-9ec1-408c-9e6f-5991a05a0990 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:58.397785 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6365fe7a-9ec1-408c-9e6f-5991a05a0990 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1407 microversion: 2.20 time: 0.205471 Jul 25 23:04:58.398660 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 81/160] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:04:58 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:04:58.403948 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-d974c058-46a5-406f-8036-5ba202d94368 req-69d9fcdc-800c-4f3f-a5e2-025c1704d98a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e78f6354-b88d-45a6-817b-4ef206d07d33", "name": "network-vif-plugged", "status": "completed", "tag": "b7e5b654-c700-4c79-966e-9953941ea57a"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:04:58.414418 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-d974c058-46a5-406f-8036-5ba202d94368 req-69d9fcdc-800c-4f3f-a5e2-025c1704d98a service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:58.414857 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-d974c058-46a5-406f-8036-5ba202d94368 req-69d9fcdc-800c-4f3f-a5e2-025c1704d98a service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:58.427502 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-d974c058-46a5-406f-8036-5ba202d94368 req-69d9fcdc-800c-4f3f-a5e2-025c1704d98a service nova] Creating event network-vif-plugged:b7e5b654-c700-4c79-966e-9953941ea57a for instance e78f6354-b88d-45a6-817b-4ef206d07d33 on hv-cinder-79760 Jul 25 23:04:58.433579 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-d974c058-46a5-406f-8036-5ba202d94368 req-69d9fcdc-800c-4f3f-a5e2-025c1704d98a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033658 Jul 25 23:04:58.434185 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 82/161] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:04:58.518339 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-1e4c7c50-65dd-4c2c-97ce-f75203b15136 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:58.519251 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-1e4c7c50-65dd-4c2c-97ce-f75203b15136 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:58.526194 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1e4c7c50-65dd-4c2c-97ce-f75203b15136 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:58.526671 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1e4c7c50-65dd-4c2c-97ce-f75203b15136 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:58.527451 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1e4c7c50-65dd-4c2c-97ce-f75203b15136 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:58.528232 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1e4c7c50-65dd-4c2c-97ce-f75203b15136 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:58.673580 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-1e4c7c50-65dd-4c2c-97ce-f75203b15136 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:58.685894 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-1e4c7c50-65dd-4c2c-97ce-f75203b15136 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1363 microversion: 2.1 time: 0.167840 Jul 25 23:04:58.685894 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 83/162] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:58 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:04:59.204722 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-eb5cf69e-3b24-493d-8a95-efbb7de2b420 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:59.204722 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-eb5cf69e-3b24-493d-8a95-efbb7de2b420 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:59.210629 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-eb5cf69e-3b24-493d-8a95-efbb7de2b420 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:59.211064 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-eb5cf69e-3b24-493d-8a95-efbb7de2b420 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:59.212097 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-eb5cf69e-3b24-493d-8a95-efbb7de2b420 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:59.213016 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-eb5cf69e-3b24-493d-8a95-efbb7de2b420 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:59.340394 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-54dc7488-5014-4437-af69-d9104e15d8cd tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "POST /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.195901 Jul 25 23:04:59.341435 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 80/163] 10.222.0.55 () {60 vars in 1323 bytes} [Mon Jul 25 23:04:57 2022] POST /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8/os-volume_attachments => generated 194 bytes in 2198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:04:59.390404 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-eb5cf69e-3b24-493d-8a95-efbb7de2b420 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:59.398432 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-eb5cf69e-3b24-493d-8a95-efbb7de2b420 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1515 microversion: 2.1 time: 0.204059 Jul 25 23:04:59.399074 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 84/164] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:59 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1515 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:04:59.424772 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e51b270d-9315-4d01-b693-a148e6cf2ea4 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:59.425008 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-4350c176-51ce-4c59-a206-03603cf50dd0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:04:59.425867 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e51b270d-9315-4d01-b693-a148e6cf2ea4 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:59.429918 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-4350c176-51ce-4c59-a206-03603cf50dd0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:59.434362 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e51b270d-9315-4d01-b693-a148e6cf2ea4 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:59.434810 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e51b270d-9315-4d01-b693-a148e6cf2ea4 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:59.435588 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e51b270d-9315-4d01-b693-a148e6cf2ea4 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:59.436019 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e51b270d-9315-4d01-b693-a148e6cf2ea4 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:59.438764 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4350c176-51ce-4c59-a206-03603cf50dd0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:59.439553 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4350c176-51ce-4c59-a206-03603cf50dd0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:59.443479 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4350c176-51ce-4c59-a206-03603cf50dd0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:59.443479 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4350c176-51ce-4c59-a206-03603cf50dd0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:59.467576 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.objects.instance [None req-4350c176-51ce-4c59-a206-03603cf50dd0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lazy-loading 'flavor' on Instance uuid be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad {{(pid=118409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 23:04:59.583013 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e51b270d-9315-4d01-b693-a148e6cf2ea4 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:59.592301 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e51b270d-9315-4d01-b693-a148e6cf2ea4 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:59.594363 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e51b270d-9315-4d01-b693-a148e6cf2ea4 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:59.595614 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e51b270d-9315-4d01-b693-a148e6cf2ea4 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1407 microversion: 2.20 time: 0.174813 Jul 25 23:04:59.595614 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 85/165] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:04:59 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:04:59.705282 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f223d05e-9398-4e5f-bfae-354df994b61d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:59.706023 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f223d05e-9398-4e5f-bfae-354df994b61d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:59.709145 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=100 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:04:59.713525 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f223d05e-9398-4e5f-bfae-354df994b61d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:59.713967 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f223d05e-9398-4e5f-bfae-354df994b61d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:59.721053 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f223d05e-9398-4e5f-bfae-354df994b61d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:59.721053 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f223d05e-9398-4e5f-bfae-354df994b61d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:59.865457 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-4350c176-51ce-4c59-a206-03603cf50dd0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "POST /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad/action" status: 200 len: 32 microversion: 2.1 time: 0.444671 Jul 25 23:04:59.870505 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 81/166] 10.222.0.55 () {60 vars in 1278 bytes} [Mon Jul 25 23:04:59 2022] POST /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad/action => generated 32 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 23:04:59.886617 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-3680f80e-acf4-45b2-9bb6-d660c1305b8b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:04:59.887912 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-3680f80e-acf4-45b2-9bb6-d660c1305b8b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:04:59.899551 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3680f80e-acf4-45b2-9bb6-d660c1305b8b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:59.900492 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3680f80e-acf4-45b2-9bb6-d660c1305b8b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:59.901312 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3680f80e-acf4-45b2-9bb6-d660c1305b8b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:04:59.901749 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3680f80e-acf4-45b2-9bb6-d660c1305b8b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:04:59.915221 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f223d05e-9398-4e5f-bfae-354df994b61d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:04:59.930928 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f223d05e-9398-4e5f-bfae-354df994b61d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1363 microversion: 2.1 time: 0.229287 Jul 25 23:04:59.932546 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 86/167] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:59 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:05:00.061149 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-3680f80e-acf4-45b2-9bb6-d660c1305b8b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:00.073395 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-3680f80e-acf4-45b2-9bb6-d660c1305b8b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1521 microversion: 2.1 time: 0.197954 Jul 25 23:05:00.075305 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 82/168] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:04:59 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:00.618403 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e14d28d6-8791-4fd3-88d1-a0a4839dd8cf tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:00.619241 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e14d28d6-8791-4fd3-88d1-a0a4839dd8cf tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:00.625443 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e14d28d6-8791-4fd3-88d1-a0a4839dd8cf tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:00.644978 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e14d28d6-8791-4fd3-88d1-a0a4839dd8cf tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:00.644978 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e14d28d6-8791-4fd3-88d1-a0a4839dd8cf tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:00.644978 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e14d28d6-8791-4fd3-88d1-a0a4839dd8cf tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:00.773464 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e14d28d6-8791-4fd3-88d1-a0a4839dd8cf tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:00.782876 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e14d28d6-8791-4fd3-88d1-a0a4839dd8cf tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:00.784429 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e14d28d6-8791-4fd3-88d1-a0a4839dd8cf tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:00.785597 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e14d28d6-8791-4fd3-88d1-a0a4839dd8cf tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1407 microversion: 2.20 time: 0.171153 Jul 25 23:05:00.786159 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 87/169] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:05:00 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:05:00.963581 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-fcfe433d-118c-413e-9060-f6ae5d64db86 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:00.964422 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-fcfe433d-118c-413e-9060-f6ae5d64db86 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:00.966484 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_api:SELECT=97 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:00.971490 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-fcfe433d-118c-413e-9060-f6ae5d64db86 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:00.972047 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-fcfe433d-118c-413e-9060-f6ae5d64db86 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:00.972673 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-fcfe433d-118c-413e-9060-f6ae5d64db86 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:00.973095 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-fcfe433d-118c-413e-9060-f6ae5d64db86 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:01.094914 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-57c9836f-b102-4072-9bb3-05aeec335e22 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:01.095589 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-57c9836f-b102-4072-9bb3-05aeec335e22 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:01.101847 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-57c9836f-b102-4072-9bb3-05aeec335e22 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:01.102332 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-57c9836f-b102-4072-9bb3-05aeec335e22 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:01.103172 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-57c9836f-b102-4072-9bb3-05aeec335e22 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:01.103596 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-57c9836f-b102-4072-9bb3-05aeec335e22 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:01.112056 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-fcfe433d-118c-413e-9060-f6ae5d64db86 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:01.119727 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-fcfe433d-118c-413e-9060-f6ae5d64db86 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1363 microversion: 2.1 time: 0.162107 Jul 25 23:05:01.120319 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 83/170] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:00 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:01.238278 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-57c9836f-b102-4072-9bb3-05aeec335e22 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:01.246300 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-57c9836f-b102-4072-9bb3-05aeec335e22 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1521 microversion: 2.1 time: 0.155128 Jul 25 23:05:01.246897 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 88/171] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:01 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:05:01.814601 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-319a3765-e5a2-49e7-9632-3c8cee4a80b6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:01.815344 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-319a3765-e5a2-49e7-9632-3c8cee4a80b6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:01.821939 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-319a3765-e5a2-49e7-9632-3c8cee4a80b6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:01.822393 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-319a3765-e5a2-49e7-9632-3c8cee4a80b6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:01.823293 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-319a3765-e5a2-49e7-9632-3c8cee4a80b6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:01.823709 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-319a3765-e5a2-49e7-9632-3c8cee4a80b6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:01.964176 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-319a3765-e5a2-49e7-9632-3c8cee4a80b6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:01.972360 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-319a3765-e5a2-49e7-9632-3c8cee4a80b6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:01.975118 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-319a3765-e5a2-49e7-9632-3c8cee4a80b6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:01.975118 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-319a3765-e5a2-49e7-9632-3c8cee4a80b6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1407 microversion: 2.20 time: 0.164638 Jul 25 23:05:01.975620 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 84/172] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:05:01 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:05:02.140310 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4e53ff4b-af6c-4c5c-8e8d-0fef59910a63 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:02.140843 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4e53ff4b-af6c-4c5c-8e8d-0fef59910a63 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:02.147154 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4e53ff4b-af6c-4c5c-8e8d-0fef59910a63 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:02.147594 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4e53ff4b-af6c-4c5c-8e8d-0fef59910a63 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:02.148351 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4e53ff4b-af6c-4c5c-8e8d-0fef59910a63 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:02.148831 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4e53ff4b-af6c-4c5c-8e8d-0fef59910a63 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:02.267687 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-570cdddc-5777-4762-9fb5-d307904940b8 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:02.268304 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-570cdddc-5777-4762-9fb5-d307904940b8 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:02.275059 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-570cdddc-5777-4762-9fb5-d307904940b8 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:02.275513 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-570cdddc-5777-4762-9fb5-d307904940b8 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:02.276811 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-570cdddc-5777-4762-9fb5-d307904940b8 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:02.277888 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-570cdddc-5777-4762-9fb5-d307904940b8 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:02.302790 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4e53ff4b-af6c-4c5c-8e8d-0fef59910a63 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:02.309891 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4e53ff4b-af6c-4c5c-8e8d-0fef59910a63 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1363 microversion: 2.1 time: 0.173493 Jul 25 23:05:02.310734 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 89/173] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:02 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:02.440478 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-570cdddc-5777-4762-9fb5-d307904940b8 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:02.448880 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-570cdddc-5777-4762-9fb5-d307904940b8 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1521 microversion: 2.1 time: 0.185338 Jul 25 23:05:02.451994 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 85/174] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:02 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:02.998604 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-9d896f95-1daa-424e-9c6a-c585ba123c28 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:02.999202 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-9d896f95-1daa-424e-9c6a-c585ba123c28 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:03.005593 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9d896f95-1daa-424e-9c6a-c585ba123c28 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:03.006029 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9d896f95-1daa-424e-9c6a-c585ba123c28 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:03.006788 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9d896f95-1daa-424e-9c6a-c585ba123c28 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:03.007209 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9d896f95-1daa-424e-9c6a-c585ba123c28 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:03.149379 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9d896f95-1daa-424e-9c6a-c585ba123c28 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:03.163452 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9d896f95-1daa-424e-9c6a-c585ba123c28 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:03.166040 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9d896f95-1daa-424e-9c6a-c585ba123c28 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:03.168228 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-9d896f95-1daa-424e-9c6a-c585ba123c28 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1407 microversion: 2.20 time: 0.174497 Jul 25 23:05:03.169314 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 90/175] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:05:02 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:05:03.333167 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-49268635-fd30-4975-9997-5fa8607b1100 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:03.335482 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-49268635-fd30-4975-9997-5fa8607b1100 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:03.345962 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-49268635-fd30-4975-9997-5fa8607b1100 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:03.346880 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-49268635-fd30-4975-9997-5fa8607b1100 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:03.347701 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-49268635-fd30-4975-9997-5fa8607b1100 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:03.348307 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-49268635-fd30-4975-9997-5fa8607b1100 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:03.375473 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:03.471678 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-96ff4a5b-f597-4420-8e32-06199868fa16 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:03.472579 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-96ff4a5b-f597-4420-8e32-06199868fa16 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:03.481044 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-96ff4a5b-f597-4420-8e32-06199868fa16 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:03.485194 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-96ff4a5b-f597-4420-8e32-06199868fa16 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:03.485194 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-96ff4a5b-f597-4420-8e32-06199868fa16 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:03.485194 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-96ff4a5b-f597-4420-8e32-06199868fa16 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:03.488111 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=100 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:03.665268 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-49268635-fd30-4975-9997-5fa8607b1100 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:03.674573 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-49268635-fd30-4975-9997-5fa8607b1100 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1549 microversion: 2.1 time: 0.345802 Jul 25 23:05:03.675194 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 86/176] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:03 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1549 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:03.697034 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-b567c347-bff6-4adc-86d5-988d39291112 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:03.697552 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-b567c347-bff6-4adc-86d5-988d39291112 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:03.704534 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b567c347-bff6-4adc-86d5-988d39291112 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:03.704977 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b567c347-bff6-4adc-86d5-988d39291112 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:03.705790 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b567c347-bff6-4adc-86d5-988d39291112 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:03.706210 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b567c347-bff6-4adc-86d5-988d39291112 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:03.729703 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-96ff4a5b-f597-4420-8e32-06199868fa16 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:03.731382 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-96ff4a5b-f597-4420-8e32-06199868fa16 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1521 microversion: 2.1 time: 0.264679 Jul 25 23:05:03.731949 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 91/177] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:03 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:03.785593 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-b567c347-bff6-4adc-86d5-988d39291112 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093034 Jul 25 23:05:03.786194 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 87/178] 10.222.0.55 () {58 vars in 1275 bytes} [Mon Jul 25 23:05:03 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 23:05:04.201632 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c794effe-2833-45b1-8184-4921f4702435 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:04.203026 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c794effe-2833-45b1-8184-4921f4702435 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:04.212453 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c794effe-2833-45b1-8184-4921f4702435 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:04.213041 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c794effe-2833-45b1-8184-4921f4702435 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:04.216399 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c794effe-2833-45b1-8184-4921f4702435 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:04.216559 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c794effe-2833-45b1-8184-4921f4702435 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:04.391112 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c794effe-2833-45b1-8184-4921f4702435 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:04.400274 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c794effe-2833-45b1-8184-4921f4702435 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:04.402813 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c794effe-2833-45b1-8184-4921f4702435 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:04.404150 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c794effe-2833-45b1-8184-4921f4702435 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1407 microversion: 2.20 time: 0.213438 Jul 25 23:05:04.404670 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 92/179] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:05:04 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:05:04.754831 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-4dc78303-1d90-49fc-8e0f-757aac01df94 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:04.756941 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-4dc78303-1d90-49fc-8e0f-757aac01df94 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:04.778016 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4dc78303-1d90-49fc-8e0f-757aac01df94 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:04.778016 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4dc78303-1d90-49fc-8e0f-757aac01df94 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:04.778016 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4dc78303-1d90-49fc-8e0f-757aac01df94 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:04.778016 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4dc78303-1d90-49fc-8e0f-757aac01df94 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:04.987834 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-4dc78303-1d90-49fc-8e0f-757aac01df94 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:05.000278 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-4dc78303-1d90-49fc-8e0f-757aac01df94 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1521 microversion: 2.1 time: 0.251245 Jul 25 23:05:05.002613 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 88/180] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:04 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:05.427875 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-529f1c6b-fb6e-4a67-9c2b-28002a41ce0f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:05.430551 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-529f1c6b-fb6e-4a67-9c2b-28002a41ce0f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:05.436054 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-529f1c6b-fb6e-4a67-9c2b-28002a41ce0f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:05.436827 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-529f1c6b-fb6e-4a67-9c2b-28002a41ce0f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:05.437254 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-529f1c6b-fb6e-4a67-9c2b-28002a41ce0f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:05.437688 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-529f1c6b-fb6e-4a67-9c2b-28002a41ce0f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:05.594101 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-2c74deec-e2e2-4472-bdc8-27b742f42adf req-2560ad52-b251-4a00-a2cb-dbf2698200d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6efbf144-c03b-44d4-ad8f-0382560ed59d", "tag": "0d5cf52c-9ff5-4944-b3a7-c07d730ee932"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:05:05.606133 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-2c74deec-e2e2-4472-bdc8-27b742f42adf req-2560ad52-b251-4a00-a2cb-dbf2698200d0 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:05.607208 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-2c74deec-e2e2-4472-bdc8-27b742f42adf req-2560ad52-b251-4a00-a2cb-dbf2698200d0 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:05.624609 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-2c74deec-e2e2-4472-bdc8-27b742f42adf req-2560ad52-b251-4a00-a2cb-dbf2698200d0 service nova] Creating event network-changed:0d5cf52c-9ff5-4944-b3a7-c07d730ee932 for instance 6efbf144-c03b-44d4-ad8f-0382560ed59d on hv-cinder-79760 Jul 25 23:05:05.634736 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-2c74deec-e2e2-4472-bdc8-27b742f42adf req-2560ad52-b251-4a00-a2cb-dbf2698200d0 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043422 Jul 25 23:05:05.638895 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 89/181] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:05:05.706592 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-529f1c6b-fb6e-4a67-9c2b-28002a41ce0f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:05.716886 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-529f1c6b-fb6e-4a67-9c2b-28002a41ce0f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:05.720511 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-529f1c6b-fb6e-4a67-9c2b-28002a41ce0f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:05.720511 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-529f1c6b-fb6e-4a67-9c2b-28002a41ce0f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1407 microversion: 2.20 time: 0.296027 Jul 25 23:05:05.721288 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 93/182] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:05:05 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1407 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:05:06.032035 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-956f8107-6af6-41af-a9d1-8532c905c09e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:06.032770 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-956f8107-6af6-41af-a9d1-8532c905c09e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:06.039305 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-956f8107-6af6-41af-a9d1-8532c905c09e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:06.039768 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-956f8107-6af6-41af-a9d1-8532c905c09e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:06.040525 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-956f8107-6af6-41af-a9d1-8532c905c09e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:06.040960 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-956f8107-6af6-41af-a9d1-8532c905c09e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:06.291940 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-956f8107-6af6-41af-a9d1-8532c905c09e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:06.320965 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-956f8107-6af6-41af-a9d1-8532c905c09e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1521 microversion: 2.1 time: 0.293522 Jul 25 23:05:06.324115 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 90/183] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:06 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:06.750603 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-bf9882ce-a0ee-4f44-8e7b-5a007d6a799a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:06.751904 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-bf9882ce-a0ee-4f44-8e7b-5a007d6a799a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:06.760980 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bf9882ce-a0ee-4f44-8e7b-5a007d6a799a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:06.761706 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bf9882ce-a0ee-4f44-8e7b-5a007d6a799a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:06.762762 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bf9882ce-a0ee-4f44-8e7b-5a007d6a799a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:06.763629 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bf9882ce-a0ee-4f44-8e7b-5a007d6a799a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:06.974575 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-bf9882ce-a0ee-4f44-8e7b-5a007d6a799a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:06.984048 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-bf9882ce-a0ee-4f44-8e7b-5a007d6a799a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:06.985953 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-bf9882ce-a0ee-4f44-8e7b-5a007d6a799a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:06.987144 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-bf9882ce-a0ee-4f44-8e7b-5a007d6a799a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1600 microversion: 2.20 time: 0.241313 Jul 25 23:05:06.987890 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 94/184] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:05:06 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1600 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:05:07.015359 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-ba3073bc-932e-4fa6-b864-62909613a132 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:07.015861 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-ba3073bc-932e-4fa6-b864-62909613a132 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:07.025363 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ba3073bc-932e-4fa6-b864-62909613a132 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:07.026635 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ba3073bc-932e-4fa6-b864-62909613a132 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:07.027476 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ba3073bc-932e-4fa6-b864-62909613a132 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:07.028445 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ba3073bc-932e-4fa6-b864-62909613a132 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:07.135314 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-ba3073bc-932e-4fa6-b864-62909613a132 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.122039 Jul 25 23:05:07.135314 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 91/185] 10.222.0.55 () {60 vars in 1316 bytes} [Mon Jul 25 23:05:07 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33/os-interface => generated 285 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 23:05:07.354636 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e327e4ef-8257-4056-9dc9-7c3c50bab870 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:07.355630 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e327e4ef-8257-4056-9dc9-7c3c50bab870 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:07.362643 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e327e4ef-8257-4056-9dc9-7c3c50bab870 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:07.363393 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e327e4ef-8257-4056-9dc9-7c3c50bab870 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:07.364440 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e327e4ef-8257-4056-9dc9-7c3c50bab870 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:07.365152 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e327e4ef-8257-4056-9dc9-7c3c50bab870 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:07.969621 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e327e4ef-8257-4056-9dc9-7c3c50bab870 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:08.000888 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e327e4ef-8257-4056-9dc9-7c3c50bab870 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1521 microversion: 2.1 time: 0.650441 Jul 25 23:05:08.003453 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 95/186] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:07 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1521 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:08.600762 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-586a99d3-5412-4326-a33f-bb1247d2cd1b req-1213d145-6168-48b2-8d2a-0d8e5b486328 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e78f6354-b88d-45a6-817b-4ef206d07d33", "tag": "b7e5b654-c700-4c79-966e-9953941ea57a"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:05:08.613183 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-586a99d3-5412-4326-a33f-bb1247d2cd1b req-1213d145-6168-48b2-8d2a-0d8e5b486328 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:08.614480 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-586a99d3-5412-4326-a33f-bb1247d2cd1b req-1213d145-6168-48b2-8d2a-0d8e5b486328 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:08.629666 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-586a99d3-5412-4326-a33f-bb1247d2cd1b req-1213d145-6168-48b2-8d2a-0d8e5b486328 service nova] Creating event network-changed:b7e5b654-c700-4c79-966e-9953941ea57a for instance e78f6354-b88d-45a6-817b-4ef206d07d33 on hv-cinder-79760 Jul 25 23:05:08.637627 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-586a99d3-5412-4326-a33f-bb1247d2cd1b req-1213d145-6168-48b2-8d2a-0d8e5b486328 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040717 Jul 25 23:05:08.641579 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 92/187] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:05:09.028448 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6f8189d0-e3bb-42f1-b399-796931a2cf57 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:09.031510 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6f8189d0-e3bb-42f1-b399-796931a2cf57 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:09.044620 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6f8189d0-e3bb-42f1-b399-796931a2cf57 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:09.045663 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6f8189d0-e3bb-42f1-b399-796931a2cf57 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:09.046465 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6f8189d0-e3bb-42f1-b399-796931a2cf57 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:09.046895 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6f8189d0-e3bb-42f1-b399-796931a2cf57 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:09.514130 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6f8189d0-e3bb-42f1-b399-796931a2cf57 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:09.531989 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6f8189d0-e3bb-42f1-b399-796931a2cf57 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1521 microversion: 2.1 time: 0.510911 Jul 25 23:05:09.545502 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 96/188] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:09 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1521 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:10.564341 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-9746d07f-a550-48ad-824a-357647b216da tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:10.568782 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-9746d07f-a550-48ad-824a-357647b216da tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:10.583195 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9746d07f-a550-48ad-824a-357647b216da tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:10.583986 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9746d07f-a550-48ad-824a-357647b216da tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:10.584996 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9746d07f-a550-48ad-824a-357647b216da tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:10.585797 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9746d07f-a550-48ad-824a-357647b216da tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:11.211470 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-9746d07f-a550-48ad-824a-357647b216da tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:11.221097 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-9746d07f-a550-48ad-824a-357647b216da tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1521 microversion: 2.1 time: 0.664755 Jul 25 23:05:11.236567 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 93/189] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:10 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1521 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:12.257351 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-464ccaeb-6f29-42f8-abcc-e3f0f0dd365a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:12.262766 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-464ccaeb-6f29-42f8-abcc-e3f0f0dd365a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:12.289252 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-464ccaeb-6f29-42f8-abcc-e3f0f0dd365a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:12.292047 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-464ccaeb-6f29-42f8-abcc-e3f0f0dd365a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:12.294476 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-464ccaeb-6f29-42f8-abcc-e3f0f0dd365a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:12.296054 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-464ccaeb-6f29-42f8-abcc-e3f0f0dd365a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:12.516850 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-464ccaeb-6f29-42f8-abcc-e3f0f0dd365a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:12.533792 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-464ccaeb-6f29-42f8-abcc-e3f0f0dd365a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1521 microversion: 2.1 time: 0.290958 Jul 25 23:05:12.534755 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 97/190] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:12 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:13.561335 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-be45954d-b396-4809-a70f-9e608e9fe159 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:13.562728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-be45954d-b396-4809-a70f-9e608e9fe159 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:13.570218 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-be45954d-b396-4809-a70f-9e608e9fe159 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:13.570675 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-be45954d-b396-4809-a70f-9e608e9fe159 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:13.571465 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-be45954d-b396-4809-a70f-9e608e9fe159 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:13.571980 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-be45954d-b396-4809-a70f-9e608e9fe159 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:13.765193 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-be45954d-b396-4809-a70f-9e608e9fe159 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:13.776253 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-be45954d-b396-4809-a70f-9e608e9fe159 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1521 microversion: 2.1 time: 0.218217 Jul 25 23:05:13.784863 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 94/191] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:13 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:14.798381 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5c5d7a07-434f-4164-ad55-631e2d1bfb2b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:14.799188 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-5c5d7a07-434f-4164-ad55-631e2d1bfb2b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:14.813627 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5c5d7a07-434f-4164-ad55-631e2d1bfb2b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:14.814333 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5c5d7a07-434f-4164-ad55-631e2d1bfb2b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:14.815259 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5c5d7a07-434f-4164-ad55-631e2d1bfb2b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:14.815784 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5c5d7a07-434f-4164-ad55-631e2d1bfb2b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:14.964740 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-5c5d7a07-434f-4164-ad55-631e2d1bfb2b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:14.973065 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-5c5d7a07-434f-4164-ad55-631e2d1bfb2b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1521 microversion: 2.1 time: 0.178980 Jul 25 23:05:14.973754 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 98/192] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:14 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:05:15.999292 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-c0b951cf-c146-41ff-bd88-bea2e915a553 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:16.001407 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-c0b951cf-c146-41ff-bd88-bea2e915a553 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:16.014130 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c0b951cf-c146-41ff-bd88-bea2e915a553 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:16.015256 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c0b951cf-c146-41ff-bd88-bea2e915a553 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:16.016630 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c0b951cf-c146-41ff-bd88-bea2e915a553 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:16.017439 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c0b951cf-c146-41ff-bd88-bea2e915a553 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:16.324312 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-c0b951cf-c146-41ff-bd88-bea2e915a553 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:16.332175 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-c0b951cf-c146-41ff-bd88-bea2e915a553 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1521 microversion: 2.1 time: 0.340575 Jul 25 23:05:16.332776 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 95/193] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:15 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1521 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:17.365795 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c27f82ba-c765-4941-9b78-ea9ef7b72b03 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:17.366411 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c27f82ba-c765-4941-9b78-ea9ef7b72b03 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:17.378199 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c27f82ba-c765-4941-9b78-ea9ef7b72b03 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:17.379927 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c27f82ba-c765-4941-9b78-ea9ef7b72b03 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:17.381001 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c27f82ba-c765-4941-9b78-ea9ef7b72b03 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:17.382160 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c27f82ba-c765-4941-9b78-ea9ef7b72b03 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:17.486593 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-9eb0742b-e7eb-49a8-b11c-61ac336a0c59 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:17.487080 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-9eb0742b-e7eb-49a8-b11c-61ac336a0c59 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:17.496562 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9eb0742b-e7eb-49a8-b11c-61ac336a0c59 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:17.497040 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9eb0742b-e7eb-49a8-b11c-61ac336a0c59 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:17.497842 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9eb0742b-e7eb-49a8-b11c-61ac336a0c59 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:17.498279 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9eb0742b-e7eb-49a8-b11c-61ac336a0c59 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:17.554686 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-9eb0742b-e7eb-49a8-b11c-61ac336a0c59 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Going to try to terminate instance {{(pid=118409) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 23:05:17.695306 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c27f82ba-c765-4941-9b78-ea9ef7b72b03 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:17.704614 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c27f82ba-c765-4941-9b78-ea9ef7b72b03 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1521 microversion: 2.1 time: 0.345584 Jul 25 23:05:17.705582 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 99/194] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:17 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1521 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:18.029886 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-9eb0742b-e7eb-49a8-b11c-61ac336a0c59 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "DELETE /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 204 len: 0 microversion: 2.1 time: 0.546466 Jul 25 23:05:18.037567 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 96/195] 10.222.0.55 () {58 vars in 1239 bytes} [Mon Jul 25 23:05:17 2022] DELETE /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 23:05:18.050646 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0fdfec1b-e4c7-4823-860c-976ab98ea2f4 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:18.051886 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-0fdfec1b-e4c7-4823-860c-976ab98ea2f4 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:18.066211 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0fdfec1b-e4c7-4823-860c-976ab98ea2f4 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:18.070937 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0fdfec1b-e4c7-4823-860c-976ab98ea2f4 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:18.070937 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0fdfec1b-e4c7-4823-860c-976ab98ea2f4 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:18.070937 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0fdfec1b-e4c7-4823-860c-976ab98ea2f4 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:18.395654 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-0fdfec1b-e4c7-4823-860c-976ab98ea2f4 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:18.409598 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-0fdfec1b-e4c7-4823-860c-976ab98ea2f4 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1553 microversion: 2.1 time: 0.370232 Jul 25 23:05:18.413477 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 100/196] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:18 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1553 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:05:18.734351 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-efaf0fef-84c4-46fd-9948-88731980d05a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:18.735186 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-efaf0fef-84c4-46fd-9948-88731980d05a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:18.746474 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-efaf0fef-84c4-46fd-9948-88731980d05a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:18.747532 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-efaf0fef-84c4-46fd-9948-88731980d05a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:18.748599 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-efaf0fef-84c4-46fd-9948-88731980d05a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:18.749321 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-efaf0fef-84c4-46fd-9948-88731980d05a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:19.093736 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-efaf0fef-84c4-46fd-9948-88731980d05a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:19.107059 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-efaf0fef-84c4-46fd-9948-88731980d05a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1521 microversion: 2.1 time: 0.379682 Jul 25 23:05:19.107734 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 97/197] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:18 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1521 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:19.446128 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-2420f035-01b9-409f-8ec3-47d44ac63a6f tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:19.447461 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-2420f035-01b9-409f-8ec3-47d44ac63a6f tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:19.459664 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2420f035-01b9-409f-8ec3-47d44ac63a6f tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:19.460077 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2420f035-01b9-409f-8ec3-47d44ac63a6f tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:19.460859 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2420f035-01b9-409f-8ec3-47d44ac63a6f tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:19.461347 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2420f035-01b9-409f-8ec3-47d44ac63a6f tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:19.620225 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-2420f035-01b9-409f-8ec3-47d44ac63a6f tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:19.628958 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-2420f035-01b9-409f-8ec3-47d44ac63a6f tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1553 microversion: 2.1 time: 0.198326 Jul 25 23:05:19.629596 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 101/198] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:19 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1553 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:20.129821 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-1985ca06-203a-48c7-bcfa-5518368c389f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:20.130981 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-1985ca06-203a-48c7-bcfa-5518368c389f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:20.143351 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1985ca06-203a-48c7-bcfa-5518368c389f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:20.143799 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1985ca06-203a-48c7-bcfa-5518368c389f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:20.144560 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1985ca06-203a-48c7-bcfa-5518368c389f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:20.146340 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1985ca06-203a-48c7-bcfa-5518368c389f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:20.654632 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c16cf1c6-90a6-4199-8dd3-0cf39a8f82eb tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:20.655398 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c16cf1c6-90a6-4199-8dd3-0cf39a8f82eb tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:20.676719 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c16cf1c6-90a6-4199-8dd3-0cf39a8f82eb tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:20.677564 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c16cf1c6-90a6-4199-8dd3-0cf39a8f82eb tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:20.679301 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c16cf1c6-90a6-4199-8dd3-0cf39a8f82eb tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:20.680122 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c16cf1c6-90a6-4199-8dd3-0cf39a8f82eb tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:20.952816 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-1985ca06-203a-48c7-bcfa-5518368c389f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:20.969381 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-1985ca06-203a-48c7-bcfa-5518368c389f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1521 microversion: 2.1 time: 0.844566 Jul 25 23:05:20.969979 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 98/199] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:20 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1521 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:21.108551 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c16cf1c6-90a6-4199-8dd3-0cf39a8f82eb tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:21.124619 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c16cf1c6-90a6-4199-8dd3-0cf39a8f82eb tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1553 microversion: 2.1 time: 0.476670 Jul 25 23:05:21.127684 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 102/200] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:20 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1553 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:21.993153 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-1ad8bdaf-3394-4879-99fe-5d973be4e9b9 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:21.995057 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-1ad8bdaf-3394-4879-99fe-5d973be4e9b9 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:22.009367 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1ad8bdaf-3394-4879-99fe-5d973be4e9b9 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:22.009834 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1ad8bdaf-3394-4879-99fe-5d973be4e9b9 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:22.010630 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1ad8bdaf-3394-4879-99fe-5d973be4e9b9 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:22.011067 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1ad8bdaf-3394-4879-99fe-5d973be4e9b9 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:22.156236 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c1f7529b-57c8-4c5b-a2f1-329ca38c9478 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:22.162823 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c1f7529b-57c8-4c5b-a2f1-329ca38c9478 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:22.178512 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c1f7529b-57c8-4c5b-a2f1-329ca38c9478 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:22.179819 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c1f7529b-57c8-4c5b-a2f1-329ca38c9478 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:22.186170 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c1f7529b-57c8-4c5b-a2f1-329ca38c9478 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:22.186951 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c1f7529b-57c8-4c5b-a2f1-329ca38c9478 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:22.452629 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c1f7529b-57c8-4c5b-a2f1-329ca38c9478 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:22.469046 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c1f7529b-57c8-4c5b-a2f1-329ca38c9478 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1511 microversion: 2.1 time: 0.321436 Jul 25 23:05:22.488217 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 103/201] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:22 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1511 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:22.498679 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-76f6a42b-d81e-4995-bb97-0a7d36915903 req-3b7425ef-7b76-405a-be08-04df04736b50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06fcf0b9-57d3-4abb-8b39-cf03d104f2a8", "name": "network-vif-deleted", "tag": "3362c499-c419-49ff-9af6-1d14b8fe4fcb"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:05:22.552059 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-76f6a42b-d81e-4995-bb97-0a7d36915903 req-3b7425ef-7b76-405a-be08-04df04736b50 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:22.552231 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-76f6a42b-d81e-4995-bb97-0a7d36915903 req-3b7425ef-7b76-405a-be08-04df04736b50 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:22.580009 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-76f6a42b-d81e-4995-bb97-0a7d36915903 req-3b7425ef-7b76-405a-be08-04df04736b50 service nova] Creating event network-vif-deleted:3362c499-c419-49ff-9af6-1d14b8fe4fcb for instance 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 on hv-cinder-79760 Jul 25 23:05:22.593460 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-76f6a42b-d81e-4995-bb97-0a7d36915903 req-3b7425ef-7b76-405a-be08-04df04736b50 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103854 Jul 25 23:05:22.595951 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 104/202] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:05:22.910327 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-1ad8bdaf-3394-4879-99fe-5d973be4e9b9 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:22.920210 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-1ad8bdaf-3394-4879-99fe-5d973be4e9b9 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1521 microversion: 2.1 time: 0.931161 Jul 25 23:05:22.921774 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 99/203] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:21 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1521 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:23.495825 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4dc3705a-60c8-4a06-ad14-0be38e237063 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:23.497035 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4dc3705a-60c8-4a06-ad14-0be38e237063 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:23.506550 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4dc3705a-60c8-4a06-ad14-0be38e237063 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:23.507392 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4dc3705a-60c8-4a06-ad14-0be38e237063 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:23.508479 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4dc3705a-60c8-4a06-ad14-0be38e237063 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:23.509485 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4dc3705a-60c8-4a06-ad14-0be38e237063 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:23.549496 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4dc3705a-60c8-4a06-ad14-0be38e237063 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:23.550214 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4dc3705a-60c8-4a06-ad14-0be38e237063 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:23.550809 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.objects.instance [None req-4dc3705a-60c8-4a06-ad14-0be38e237063 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lazy-loading 'fault' on Instance uuid 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 {{(pid=118410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 23:05:23.686864 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4dc3705a-60c8-4a06-ad14-0be38e237063 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20625ee0dcb0427183ad6f9865ff5764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3154bd58b544d0d857e5b3918783cc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:23.698442 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4dc3705a-60c8-4a06-ad14-0be38e237063 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 200 len: 1350 microversion: 2.1 time: 0.210674 Jul 25 23:05:23.699079 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 105/204] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:23 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 1350 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:23.941782 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-3f7d4eca-c942-4ef3-aa21-b0aaa70d742d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:23.942552 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-3f7d4eca-c942-4ef3-aa21-b0aaa70d742d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:23.952320 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3f7d4eca-c942-4ef3-aa21-b0aaa70d742d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:23.952889 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3f7d4eca-c942-4ef3-aa21-b0aaa70d742d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:23.953883 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3f7d4eca-c942-4ef3-aa21-b0aaa70d742d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:23.954387 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3f7d4eca-c942-4ef3-aa21-b0aaa70d742d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:24.542218 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-3f7d4eca-c942-4ef3-aa21-b0aaa70d742d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:24.552258 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-3f7d4eca-c942-4ef3-aa21-b0aaa70d742d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1521 microversion: 2.1 time: 0.614225 Jul 25 23:05:24.552843 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 100/205] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:23 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1521 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:24.720335 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0e5166eb-5320-4ed9-9d38-c78bc9c95c52 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:24.720936 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-0e5166eb-5320-4ed9-9d38-c78bc9c95c52 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:24.745270 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0e5166eb-5320-4ed9-9d38-c78bc9c95c52 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:24.750498 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0e5166eb-5320-4ed9-9d38-c78bc9c95c52 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:24.752790 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0e5166eb-5320-4ed9-9d38-c78bc9c95c52 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:24.755899 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0e5166eb-5320-4ed9-9d38-c78bc9c95c52 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:24.772824 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-0e5166eb-5320-4ed9-9d38-c78bc9c95c52 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] HTTP exception thrown: Instance 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 could not be found. Jul 25 23:05:24.797538 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0e5166eb-5320-4ed9-9d38-c78bc9c95c52 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Request method failure captured: Jul 25 23:05:24.797538 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 HTTP/1.1 Jul 25 23:05:24.797538 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 25 23:05:24.797538 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 25 23:05:24.797538 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Connection: close Jul 25 23:05:24.797538 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 25 23:05:24.797538 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 25 23:05:24.797538 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Host: 10.222.0.55 Jul 25 23:05:24.797538 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 25 23:05:24.797538 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.10 Jul 25 23:05:24.797538 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABi3yFhHX1JZEUCqJRLsVIhGCpkcfLBbhBaHT-ORnzjLGIjLFsT-tFw-E6-lRzC_4fZ-u2p6spJKnzVFlTlNyICIMhMJbiN7KE5QivzmKxQsnNIiJ_ZWus8bgKLSypN9EexurJ3jAUQGU5sl9VceR2avXjizy1pHHJqe3EmJekijB1kmOU Jul 25 23:05:24.797538 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 25 23:05:24.797538 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 25 23:05:24.797538 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 25 23:05:24.797538 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 25 23:05:24.797538 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 25 23:05:24.797538 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 25 23:05:24.797538 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Id: e3154bd58b544d0d857e5b3918783cc9 Jul 25 23:05:24.797538 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-DeleteServersTestJSON-876238856 Jul 25 23:05:24.797538 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Role: reader,member Jul 25 23:05:24.797538 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Roles: reader,member Jul 25 23:05:24.799098 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e3154bd58b544d0d857e5b3918783cc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e3154bd58b544d0d857e5b3918783cc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e3154bd58b544d0d857e5b3918783cc9", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e3154bd58b544d0d857e5b3918783cc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:05:24.799098 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-DeleteServersTestJSON-876238856 Jul 25 23:05:24.799098 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Id: e3154bd58b544d0d857e5b3918783cc9 Jul 25 23:05:24.799098 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-DeleteServersTestJSON-876238856 Jul 25 23:05:24.799098 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User: tempest-DeleteServersTestJSON-876238856-project Jul 25 23:05:24.799098 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 25 23:05:24.799098 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 25 23:05:24.799098 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Id: 20625ee0dcb0427183ad6f9865ff5764 Jul 25 23:05:24.799098 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-DeleteServersTestJSON-876238856-project Jul 25 23:05:24.799098 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: method: > Jul 25 23:05:24.799098 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: exception: Instance 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 could not be found. Jul 25 23:05:24.799098 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: action_args: {'id': '06fcf0b9-57d3-4abb-8b39-cf03d104f2a8'} Jul 25 23:05:24.800001 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:05:24.800001 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:05:24.800001 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:05:24.800001 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:05:24.800001 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:05:24.800001 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:05:24.800001 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:05:24.800001 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:05:24.800001 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:05:24.800001 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:05:24.800001 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 could not be found. Jul 25 23:05:24.800001 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:05:24.800001 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:05:24.800001 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:05:24.800001 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:05:24.800001 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:05:24.800001 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:05:24.800001 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:05:24.800001 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:05:24.800001 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:05:24.801405 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:05:24.801405 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 23:05:24.801405 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 23:05:24.801405 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:05:24.801405 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:05:24.801405 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:05:24.801405 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:05:24.801405 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 could not be found. Jul 25 23:05:24.801405 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:05:24.801405 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:05:24.801405 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:05:24.801405 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:05:24.801405 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:05:24.801405 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:05:24.801405 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:05:24.801405 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:05:24.801405 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 could not be found. Jul 25 23:05:24.801405 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:05:24.804027 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0e5166eb-5320-4ed9-9d38-c78bc9c95c52 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Returning 404 to user: Instance 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:05:24.804917 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-0e5166eb-5320-4ed9-9d38-c78bc9c95c52 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 404 len: 111 microversion: 2.1 time: 0.088729 Jul 25 23:05:24.805525 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 106/206] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:24 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:05:25.086585 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-1f7a3b2a-dc73-4df0-be5e-22bb0964b38e tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:25.088914 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-1f7a3b2a-dc73-4df0-be5e-22bb0964b38e tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:25.100570 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1f7a3b2a-dc73-4df0-be5e-22bb0964b38e tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:25.101154 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1f7a3b2a-dc73-4df0-be5e-22bb0964b38e tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:25.102300 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1f7a3b2a-dc73-4df0-be5e-22bb0964b38e tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:25.104739 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1f7a3b2a-dc73-4df0-be5e-22bb0964b38e tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:25.131431 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.wsgi [None req-1f7a3b2a-dc73-4df0-be5e-22bb0964b38e tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] HTTP exception thrown: Instance 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 could not be found. Jul 25 23:05:25.137321 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-1f7a3b2a-dc73-4df0-be5e-22bb0964b38e tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Request method failure captured: Jul 25 23:05:25.137321 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: request: GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8/os-volume_attachments HTTP/1.1 Jul 25 23:05:25.137321 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept: application/json Jul 25 23:05:25.137321 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept-Encoding: identity Jul 25 23:05:25.137321 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Connection: close Jul 25 23:05:25.137321 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Length: 0 Jul 25 23:05:25.137321 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Type: application/json Jul 25 23:05:25.137321 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Host: 10.222.0.55 Jul 25 23:05:25.137321 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Openstack-System-Scope: None Jul 25 23:05:25.137321 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: User-Agent: python-urllib3/1.26.10 Jul 25 23:05:25.137321 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Auth-Token: gAAAAABi3yFhHX1JZEUCqJRLsVIhGCpkcfLBbhBaHT-ORnzjLGIjLFsT-tFw-E6-lRzC_4fZ-u2p6spJKnzVFlTlNyICIMhMJbiN7KE5QivzmKxQsnNIiJ_ZWus8bgKLSypN9EexurJ3jAUQGU5sl9VceR2avXjizy1pHHJqe3EmJekijB1kmOU Jul 25 23:05:25.137321 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Id: None Jul 25 23:05:25.137321 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Name: None Jul 25 23:05:25.137321 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Identity-Status: Confirmed Jul 25 23:05:25.137321 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Is-Admin-Project: True Jul 25 23:05:25.137321 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Id: default Jul 25 23:05:25.137321 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Name: Default Jul 25 23:05:25.137321 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Id: e3154bd58b544d0d857e5b3918783cc9 Jul 25 23:05:25.137321 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Name: tempest-DeleteServersTestJSON-876238856 Jul 25 23:05:25.137321 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Role: reader,member Jul 25 23:05:25.137321 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Roles: reader,member Jul 25 23:05:25.138706 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e3154bd58b544d0d857e5b3918783cc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e3154bd58b544d0d857e5b3918783cc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e3154bd58b544d0d857e5b3918783cc9", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e3154bd58b544d0d857e5b3918783cc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:05:25.138706 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant: tempest-DeleteServersTestJSON-876238856 Jul 25 23:05:25.138706 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Id: e3154bd58b544d0d857e5b3918783cc9 Jul 25 23:05:25.138706 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Name: tempest-DeleteServersTestJSON-876238856 Jul 25 23:05:25.138706 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User: tempest-DeleteServersTestJSON-876238856-project Jul 25 23:05:25.138706 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Id: default Jul 25 23:05:25.138706 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Name: Default Jul 25 23:05:25.138706 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Id: 20625ee0dcb0427183ad6f9865ff5764 Jul 25 23:05:25.138706 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Name: tempest-DeleteServersTestJSON-876238856-project Jul 25 23:05:25.138706 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: method: > Jul 25 23:05:25.138706 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: exception: Instance 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 could not be found. Jul 25 23:05:25.138706 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: action_args: {'server_id': '06fcf0b9-57d3-4abb-8b39-cf03d104f2a8'} Jul 25 23:05:25.139506 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:05:25.139506 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:05:25.139506 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:05:25.139506 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:05:25.139506 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:05:25.139506 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:05:25.139506 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:05:25.139506 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:05:25.139506 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:05:25.139506 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:05:25.139506 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 could not be found. Jul 25 23:05:25.139506 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:05:25.139506 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:05:25.139506 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:05:25.139506 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:05:25.139506 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:05:25.139506 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:05:25.139506 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:05:25.139506 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:05:25.139506 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:05:25.140937 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:05:25.140937 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 23:05:25.140937 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 23:05:25.140937 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 25 23:05:25.140937 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 23:05:25.140937 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 25 23:05:25.140937 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 25 23:05:25.140937 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:05:25.140937 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:05:25.140937 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 could not be found. Jul 25 23:05:25.140937 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:05:25.140937 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:05:25.140937 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:05:25.140937 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:05:25.140937 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:05:25.140937 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:05:25.140937 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:05:25.140937 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:05:25.140937 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 could not be found. Jul 25 23:05:25.140937 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:05:25.143817 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-1f7a3b2a-dc73-4df0-be5e-22bb0964b38e tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Returning 404 to user: Instance 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 could not be found. {{(pid=118409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:05:25.145464 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-1f7a3b2a-dc73-4df0-be5e-22bb0964b38e tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.064067 Jul 25 23:05:25.166555 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 101/207] 10.222.0.55 () {58 vars in 1302 bytes} [Mon Jul 25 23:05:25 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8/os-volume_attachments => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:05:25.576089 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-af0110f0-de15-4f9f-8353-4008a30fea9a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:25.576089 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-af0110f0-de15-4f9f-8353-4008a30fea9a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:25.581373 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-af0110f0-de15-4f9f-8353-4008a30fea9a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:25.582059 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-af0110f0-de15-4f9f-8353-4008a30fea9a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:25.582848 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-af0110f0-de15-4f9f-8353-4008a30fea9a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:25.583239 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-af0110f0-de15-4f9f-8353-4008a30fea9a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:25.830284 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-af0110f0-de15-4f9f-8353-4008a30fea9a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:25.838749 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-af0110f0-de15-4f9f-8353-4008a30fea9a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1521 microversion: 2.1 time: 0.268692 Jul 25 23:05:25.853942 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 107/208] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:25 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:26.633160 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-323f3661-7603-4fa1-88c7-b0cfbd34a1e0 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:26.633642 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-323f3661-7603-4fa1-88c7-b0cfbd34a1e0 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:26.643194 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-323f3661-7603-4fa1-88c7-b0cfbd34a1e0 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:26.644420 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-323f3661-7603-4fa1-88c7-b0cfbd34a1e0 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:26.645679 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-323f3661-7603-4fa1-88c7-b0cfbd34a1e0 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:26.646191 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-323f3661-7603-4fa1-88c7-b0cfbd34a1e0 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:26.664326 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.wsgi [None req-323f3661-7603-4fa1-88c7-b0cfbd34a1e0 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] HTTP exception thrown: Instance 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 could not be found. Jul 25 23:05:26.667187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-323f3661-7603-4fa1-88c7-b0cfbd34a1e0 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Request method failure captured: Jul 25 23:05:26.667187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: request: DELETE /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 HTTP/1.1 Jul 25 23:05:26.667187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept: application/json Jul 25 23:05:26.667187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept-Encoding: identity Jul 25 23:05:26.667187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Connection: close Jul 25 23:05:26.667187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Length: 0 Jul 25 23:05:26.667187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Type: application/json Jul 25 23:05:26.667187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Host: 10.222.0.55 Jul 25 23:05:26.667187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Openstack-System-Scope: None Jul 25 23:05:26.667187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: User-Agent: python-urllib3/1.26.10 Jul 25 23:05:26.667187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Auth-Token: gAAAAABi3yFhHX1JZEUCqJRLsVIhGCpkcfLBbhBaHT-ORnzjLGIjLFsT-tFw-E6-lRzC_4fZ-u2p6spJKnzVFlTlNyICIMhMJbiN7KE5QivzmKxQsnNIiJ_ZWus8bgKLSypN9EexurJ3jAUQGU5sl9VceR2avXjizy1pHHJqe3EmJekijB1kmOU Jul 25 23:05:26.667187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Id: None Jul 25 23:05:26.667187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Name: None Jul 25 23:05:26.667187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Identity-Status: Confirmed Jul 25 23:05:26.667187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Is-Admin-Project: True Jul 25 23:05:26.667187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Id: default Jul 25 23:05:26.667187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Name: Default Jul 25 23:05:26.667187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Id: e3154bd58b544d0d857e5b3918783cc9 Jul 25 23:05:26.667187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Name: tempest-DeleteServersTestJSON-876238856 Jul 25 23:05:26.667187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Role: reader,member Jul 25 23:05:26.667187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Roles: reader,member Jul 25 23:05:26.669604 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e3154bd58b544d0d857e5b3918783cc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e3154bd58b544d0d857e5b3918783cc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e3154bd58b544d0d857e5b3918783cc9", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e3154bd58b544d0d857e5b3918783cc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:05:26.669604 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant: tempest-DeleteServersTestJSON-876238856 Jul 25 23:05:26.669604 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Id: e3154bd58b544d0d857e5b3918783cc9 Jul 25 23:05:26.669604 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Name: tempest-DeleteServersTestJSON-876238856 Jul 25 23:05:26.669604 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User: tempest-DeleteServersTestJSON-876238856-project Jul 25 23:05:26.669604 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Id: default Jul 25 23:05:26.669604 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Name: Default Jul 25 23:05:26.669604 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Id: 20625ee0dcb0427183ad6f9865ff5764 Jul 25 23:05:26.669604 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Name: tempest-DeleteServersTestJSON-876238856-project Jul 25 23:05:26.669604 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: method: > Jul 25 23:05:26.669604 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: exception: Instance 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 could not be found. Jul 25 23:05:26.669604 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: action_args: {'id': '06fcf0b9-57d3-4abb-8b39-cf03d104f2a8'} Jul 25 23:05:26.670395 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:05:26.670395 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:05:26.670395 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:05:26.670395 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:05:26.670395 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:05:26.670395 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:05:26.670395 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:05:26.670395 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:05:26.670395 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:05:26.670395 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:05:26.670395 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 could not be found. Jul 25 23:05:26.670395 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:05:26.670395 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:05:26.670395 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:05:26.670395 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:05:26.670395 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:05:26.670395 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:05:26.670395 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:05:26.670395 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:05:26.670395 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:05:26.672262 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:05:26.672262 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 23:05:26.672262 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 23:05:26.672262 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 23:05:26.672262 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 23:05:26.672262 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:05:26.672262 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:05:26.672262 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:05:26.672262 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:05:26.672262 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 could not be found. Jul 25 23:05:26.672262 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:05:26.672262 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:05:26.672262 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:05:26.672262 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:05:26.672262 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:05:26.672262 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:05:26.672262 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:05:26.672262 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:05:26.672262 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 could not be found. Jul 25 23:05:26.672262 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:05:26.675844 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-323f3661-7603-4fa1-88c7-b0cfbd34a1e0 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Returning 404 to user: Instance 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 could not be found. {{(pid=118409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:05:26.676973 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-323f3661-7603-4fa1-88c7-b0cfbd34a1e0 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "DELETE /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 404 len: 111 microversion: 2.1 time: 0.049058 Jul 25 23:05:26.682803 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 102/209] 10.222.0.55 () {58 vars in 1239 bytes} [Mon Jul 25 23:05:26 2022] DELETE /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:05:26.686386 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d942a9c5-dc94-41b3-ad22-39199d0fa137 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:26.686998 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-d942a9c5-dc94-41b3-ad22-39199d0fa137 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] [instance: 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:26.694001 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d942a9c5-dc94-41b3-ad22-39199d0fa137 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:26.694446 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d942a9c5-dc94-41b3-ad22-39199d0fa137 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:26.695219 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d942a9c5-dc94-41b3-ad22-39199d0fa137 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:26.695648 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d942a9c5-dc94-41b3-ad22-39199d0fa137 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:26.728449 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-d942a9c5-dc94-41b3-ad22-39199d0fa137 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] HTTP exception thrown: Instance 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 could not be found. Jul 25 23:05:26.730082 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d942a9c5-dc94-41b3-ad22-39199d0fa137 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Request method failure captured: Jul 25 23:05:26.730082 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 HTTP/1.1 Jul 25 23:05:26.730082 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 25 23:05:26.730082 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 25 23:05:26.730082 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Connection: close Jul 25 23:05:26.730082 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 25 23:05:26.730082 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 25 23:05:26.730082 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Host: 10.222.0.55 Jul 25 23:05:26.730082 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 25 23:05:26.730082 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.10 Jul 25 23:05:26.730082 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABi3yFhHX1JZEUCqJRLsVIhGCpkcfLBbhBaHT-ORnzjLGIjLFsT-tFw-E6-lRzC_4fZ-u2p6spJKnzVFlTlNyICIMhMJbiN7KE5QivzmKxQsnNIiJ_ZWus8bgKLSypN9EexurJ3jAUQGU5sl9VceR2avXjizy1pHHJqe3EmJekijB1kmOU Jul 25 23:05:26.730082 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 25 23:05:26.730082 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 25 23:05:26.730082 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 25 23:05:26.730082 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 25 23:05:26.730082 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 25 23:05:26.730082 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 25 23:05:26.730082 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Id: e3154bd58b544d0d857e5b3918783cc9 Jul 25 23:05:26.730082 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-DeleteServersTestJSON-876238856 Jul 25 23:05:26.730082 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Role: reader,member Jul 25 23:05:26.730082 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Roles: reader,member Jul 25 23:05:26.732567 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e3154bd58b544d0d857e5b3918783cc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/e3154bd58b544d0d857e5b3918783cc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_e3154bd58b544d0d857e5b3918783cc9", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/e3154bd58b544d0d857e5b3918783cc9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:05:26.732567 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-DeleteServersTestJSON-876238856 Jul 25 23:05:26.732567 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Id: e3154bd58b544d0d857e5b3918783cc9 Jul 25 23:05:26.732567 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-DeleteServersTestJSON-876238856 Jul 25 23:05:26.732567 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User: tempest-DeleteServersTestJSON-876238856-project Jul 25 23:05:26.732567 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 25 23:05:26.732567 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 25 23:05:26.732567 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Id: 20625ee0dcb0427183ad6f9865ff5764 Jul 25 23:05:26.732567 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-DeleteServersTestJSON-876238856-project Jul 25 23:05:26.732567 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: method: > Jul 25 23:05:26.732567 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: exception: Instance 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 could not be found. Jul 25 23:05:26.732567 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: action_args: {'id': '06fcf0b9-57d3-4abb-8b39-cf03d104f2a8'} Jul 25 23:05:26.733308 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:05:26.733308 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:05:26.733308 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:05:26.733308 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:05:26.733308 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:05:26.733308 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:05:26.733308 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:05:26.733308 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:05:26.733308 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:05:26.733308 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:05:26.733308 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 could not be found. Jul 25 23:05:26.733308 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:05:26.733308 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:05:26.733308 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:05:26.733308 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:05:26.733308 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:05:26.733308 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:05:26.733308 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:05:26.733308 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:05:26.733308 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:05:26.734331 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:05:26.734331 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 23:05:26.734331 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 23:05:26.734331 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:05:26.734331 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:05:26.734331 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:05:26.734331 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:05:26.734331 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 could not be found. Jul 25 23:05:26.734331 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:05:26.734331 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:05:26.734331 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:05:26.734331 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:05:26.734331 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:05:26.734331 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:05:26.734331 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:05:26.734331 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:05:26.734331 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 could not be found. Jul 25 23:05:26.734331 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:05:26.735283 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d942a9c5-dc94-41b3-ad22-39199d0fa137 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] Returning 404 to user: Instance 06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:05:26.735283 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-d942a9c5-dc94-41b3-ad22-39199d0fa137 tempest-DeleteServersTestJSON-876238856 tempest-DeleteServersTestJSON-876238856-project] 10.222.0.55 "GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8" status: 404 len: 111 microversion: 2.1 time: 0.048968 Jul 25 23:05:26.739051 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 108/210] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:26 2022] GET /compute/v2.1/servers/06fcf0b9-57d3-4abb-8b39-cf03d104f2a8 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:05:26.878463 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-2eae9a41-ddb1-453d-9938-c2f7550ac8d0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:26.879072 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-2eae9a41-ddb1-453d-9938-c2f7550ac8d0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:26.885545 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2eae9a41-ddb1-453d-9938-c2f7550ac8d0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:26.886229 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2eae9a41-ddb1-453d-9938-c2f7550ac8d0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:26.887212 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2eae9a41-ddb1-453d-9938-c2f7550ac8d0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:26.887802 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2eae9a41-ddb1-453d-9938-c2f7550ac8d0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:27.246155 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-2eae9a41-ddb1-453d-9938-c2f7550ac8d0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:27.251018 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-2eae9a41-ddb1-453d-9938-c2f7550ac8d0 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1521 microversion: 2.1 time: 0.376571 Jul 25 23:05:27.251888 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 103/211] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:26 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1521 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:28.276577 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c2155b9c-eb30-44b2-9068-7b31a1e26907 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:28.276577 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c2155b9c-eb30-44b2-9068-7b31a1e26907 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:28.297616 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c2155b9c-eb30-44b2-9068-7b31a1e26907 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:28.298334 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c2155b9c-eb30-44b2-9068-7b31a1e26907 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:28.299416 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c2155b9c-eb30-44b2-9068-7b31a1e26907 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:28.300041 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c2155b9c-eb30-44b2-9068-7b31a1e26907 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:28.347694 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=100 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:28.707452 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c2155b9c-eb30-44b2-9068-7b31a1e26907 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:28.736412 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c2155b9c-eb30-44b2-9068-7b31a1e26907 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1501 microversion: 2.1 time: 0.461765 Jul 25 23:05:28.739684 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 109/212] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:28 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1501 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:28.763081 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-33628ddb-c337-46eb-a43a-3fd56331c2b8 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:28.764290 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-33628ddb-c337-46eb-a43a-3fd56331c2b8 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:28.773016 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-33628ddb-c337-46eb-a43a-3fd56331c2b8 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:28.773790 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-33628ddb-c337-46eb-a43a-3fd56331c2b8 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:28.775310 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-33628ddb-c337-46eb-a43a-3fd56331c2b8 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:28.776241 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-33628ddb-c337-46eb-a43a-3fd56331c2b8 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:28.836987 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:29.096060 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-33628ddb-c337-46eb-a43a-3fd56331c2b8 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:29.111065 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-33628ddb-c337-46eb-a43a-3fd56331c2b8 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1517 microversion: 2.1 time: 0.351883 Jul 25 23:05:29.113221 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 104/213] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:28 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1517 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:31.631140 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-30556390-b355-485c-96e9-68fcfbaf7035 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:05:31.633639 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-30556390-b355-485c-96e9-68fcfbaf7035 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:31.646650 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=49 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:31.648956 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-30556390-b355-485c-96e9-68fcfbaf7035 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:31.651653 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-30556390-b355-485c-96e9-68fcfbaf7035 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:31.653087 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-30556390-b355-485c-96e9-68fcfbaf7035 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:31.655642 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-30556390-b355-485c-96e9-68fcfbaf7035 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:31.796436 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.objects.instance [None req-30556390-b355-485c-96e9-68fcfbaf7035 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lazy-loading 'flavor' on Instance uuid f79f5efc-af32-4b3a-975a-aef5b386752f {{(pid=118410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 23:05:32.275483 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-30556390-b355-485c-96e9-68fcfbaf7035 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "POST /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f/action" status: 200 len: 32 microversion: 2.1 time: 0.650315 Jul 25 23:05:32.276608 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 110/214] 10.222.0.55 () {60 vars in 1278 bytes} [Mon Jul 25 23:05:31 2022] POST /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f/action => generated 32 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 23:05:32.288315 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-373757c3-d6b1-440f-ac83-235d46f1f93c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:32.289519 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-373757c3-d6b1-440f-ac83-235d46f1f93c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:32.294778 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:32.310227 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-373757c3-d6b1-440f-ac83-235d46f1f93c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:32.310875 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-373757c3-d6b1-440f-ac83-235d46f1f93c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:32.313503 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-373757c3-d6b1-440f-ac83-235d46f1f93c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:32.314453 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-373757c3-d6b1-440f-ac83-235d46f1f93c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:32.911609 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-373757c3-d6b1-440f-ac83-235d46f1f93c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:32.926889 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-373757c3-d6b1-440f-ac83-235d46f1f93c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1523 microversion: 2.1 time: 0.643848 Jul 25 23:05:32.934048 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 105/215] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:32 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1523 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:33.955510 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-930d3d1b-1149-43e5-9e30-0b918d79dd4f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:33.956217 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-930d3d1b-1149-43e5-9e30-0b918d79dd4f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:33.963814 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-930d3d1b-1149-43e5-9e30-0b918d79dd4f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:33.964264 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-930d3d1b-1149-43e5-9e30-0b918d79dd4f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:33.965036 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-930d3d1b-1149-43e5-9e30-0b918d79dd4f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:33.965497 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-930d3d1b-1149-43e5-9e30-0b918d79dd4f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:34.195443 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-930d3d1b-1149-43e5-9e30-0b918d79dd4f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:34.218312 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-930d3d1b-1149-43e5-9e30-0b918d79dd4f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1523 microversion: 2.1 time: 0.267489 Jul 25 23:05:34.233611 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 111/216] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:33 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1523 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:35.239722 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-b6753272-bffe-49a7-abf2-6bec1edfe2c1 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:35.243508 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-b6753272-bffe-49a7-abf2-6bec1edfe2c1 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:35.259359 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b6753272-bffe-49a7-abf2-6bec1edfe2c1 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:35.260112 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b6753272-bffe-49a7-abf2-6bec1edfe2c1 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:35.260917 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b6753272-bffe-49a7-abf2-6bec1edfe2c1 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:35.265737 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b6753272-bffe-49a7-abf2-6bec1edfe2c1 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:35.453976 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-b6753272-bffe-49a7-abf2-6bec1edfe2c1 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:35.461530 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-b6753272-bffe-49a7-abf2-6bec1edfe2c1 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1523 microversion: 2.1 time: 0.226473 Jul 25 23:05:35.463120 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 106/217] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:35 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:36.486569 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-870f3f87-746b-4eea-8ed8-0a545554eeea tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:36.487544 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-870f3f87-746b-4eea-8ed8-0a545554eeea tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:36.497999 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-870f3f87-746b-4eea-8ed8-0a545554eeea tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:36.498459 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-870f3f87-746b-4eea-8ed8-0a545554eeea tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:36.499324 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-870f3f87-746b-4eea-8ed8-0a545554eeea tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:36.499757 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-870f3f87-746b-4eea-8ed8-0a545554eeea tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:36.737329 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-870f3f87-746b-4eea-8ed8-0a545554eeea tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:36.750596 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-870f3f87-746b-4eea-8ed8-0a545554eeea tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1523 microversion: 2.1 time: 0.270133 Jul 25 23:05:36.751510 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 112/218] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:36 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1523 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:37.772874 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-8420c184-3fb1-499d-abaa-a6dd0873c0c8 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:37.773585 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-8420c184-3fb1-499d-abaa-a6dd0873c0c8 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:37.781873 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8420c184-3fb1-499d-abaa-a6dd0873c0c8 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:37.782354 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8420c184-3fb1-499d-abaa-a6dd0873c0c8 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:37.783347 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8420c184-3fb1-499d-abaa-a6dd0873c0c8 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:37.783935 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8420c184-3fb1-499d-abaa-a6dd0873c0c8 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:37.932015 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-8420c184-3fb1-499d-abaa-a6dd0873c0c8 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:37.939549 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-8420c184-3fb1-499d-abaa-a6dd0873c0c8 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1523 microversion: 2.1 time: 0.170821 Jul 25 23:05:37.940109 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 107/219] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:37 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:38.961482 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4d5b5b2c-9f57-41dc-aa96-9e8a95c95018 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:38.963379 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4d5b5b2c-9f57-41dc-aa96-9e8a95c95018 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:38.971345 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4d5b5b2c-9f57-41dc-aa96-9e8a95c95018 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:38.972044 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4d5b5b2c-9f57-41dc-aa96-9e8a95c95018 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:38.973170 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4d5b5b2c-9f57-41dc-aa96-9e8a95c95018 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:38.973828 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4d5b5b2c-9f57-41dc-aa96-9e8a95c95018 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:39.124506 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4d5b5b2c-9f57-41dc-aa96-9e8a95c95018 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:39.137003 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4d5b5b2c-9f57-41dc-aa96-9e8a95c95018 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1523 microversion: 2.1 time: 0.179133 Jul 25 23:05:39.138657 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 113/220] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:38 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:40.159069 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-b51e5290-33f6-4a8f-9cd0-b273886eca62 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:40.159934 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-b51e5290-33f6-4a8f-9cd0-b273886eca62 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:40.185950 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b51e5290-33f6-4a8f-9cd0-b273886eca62 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:40.185950 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b51e5290-33f6-4a8f-9cd0-b273886eca62 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:40.185950 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b51e5290-33f6-4a8f-9cd0-b273886eca62 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:40.185950 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b51e5290-33f6-4a8f-9cd0-b273886eca62 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:40.629215 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-b51e5290-33f6-4a8f-9cd0-b273886eca62 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:40.639289 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-b51e5290-33f6-4a8f-9cd0-b273886eca62 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1523 microversion: 2.1 time: 0.484352 Jul 25 23:05:40.641100 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 108/221] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:40 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1523 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:05:41.664306 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6974af61-c88d-4177-acc3-4754dbdd95c7 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:41.665908 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6974af61-c88d-4177-acc3-4754dbdd95c7 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:41.673150 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6974af61-c88d-4177-acc3-4754dbdd95c7 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:41.673648 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6974af61-c88d-4177-acc3-4754dbdd95c7 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:41.674596 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6974af61-c88d-4177-acc3-4754dbdd95c7 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:41.675031 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6974af61-c88d-4177-acc3-4754dbdd95c7 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:41.830578 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6974af61-c88d-4177-acc3-4754dbdd95c7 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:41.839227 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6974af61-c88d-4177-acc3-4754dbdd95c7 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1523 microversion: 2.1 time: 0.180016 Jul 25 23:05:41.868768 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 114/222] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:41 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:42.861882 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-1ef44186-bd71-4786-983e-94b178cff4f3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:42.862550 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-1ef44186-bd71-4786-983e-94b178cff4f3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:42.869593 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1ef44186-bd71-4786-983e-94b178cff4f3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:42.870302 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1ef44186-bd71-4786-983e-94b178cff4f3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:42.871270 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1ef44186-bd71-4786-983e-94b178cff4f3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:42.871737 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1ef44186-bd71-4786-983e-94b178cff4f3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:43.019469 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-1ef44186-bd71-4786-983e-94b178cff4f3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:43.028296 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-1ef44186-bd71-4786-983e-94b178cff4f3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1523 microversion: 2.1 time: 0.171014 Jul 25 23:05:43.028935 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 109/223] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:42 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:43.437712 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5972a570-1393-4c31-a090-e07563c04422 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Action: 'create', calling method: .version_select at 0x7f622c0b0040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-84918714", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC20B3p4gTU331EwSy94K+KEC5FEsrVBzT+EOIulNUegmFwfNg1cnNjM3gYUMuMHjoRxa/8PYqiZMCDLpdyNuK8vYwR09Fh0TIls3nhL1KCtR3rlAZSUX0Jcv7Bfck/Uqw=="}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:05:43.456403 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-5972a570-1393-4c31-a090-e07563c04422 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Getting quotas for project d0af93f7c6b54114b0e1b5c32e3bf623. Resources: {'key_pairs'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 23:05:43.460688 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-5972a570-1393-4c31-a090-e07563c04422 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Getting quotas for user 2c4c72b9c83a4967b57b6633f9934dd4 and project d0af93f7c6b54114b0e1b5c32e3bf623. Resources: {'key_pairs'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 23:05:43.606653 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-5972a570-1393-4c31-a090-e07563c04422 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.172832 Jul 25 23:05:43.607680 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 115/224] 10.222.0.55 () {60 vars in 1159 bytes} [Mon Jul 25 23:05:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:05:43.723344 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-77e0e6c6-11b6-4d44-99ac-32baabc23725 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2075249443", "imageRef": "f30166fb-cee4-499c-a6aa-988275e98c3b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-84918714", "networks": [{"uuid": "b73fa538-e470-496f-b938-c0b7cd072cfd"}]}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:05:43.778630 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.network.neutron [None req-77e0e6c6-11b6-4d44-99ac-32baabc23725 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] validate_networks() for [('b73fa538-e470-496f-b938-c0b7cd072cfd', None, None, None, None, None)] {{(pid=118409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 23:05:44.049594 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-8a9226c6-08c8-4bd8-b0ce-e8ab6d4d845b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:44.050194 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-8a9226c6-08c8-4bd8-b0ce-e8ab6d4d845b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:44.059627 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8a9226c6-08c8-4bd8-b0ce-e8ab6d4d845b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:44.060264 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8a9226c6-08c8-4bd8-b0ce-e8ab6d4d845b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:44.061246 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8a9226c6-08c8-4bd8-b0ce-e8ab6d4d845b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:44.061821 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8a9226c6-08c8-4bd8-b0ce-e8ab6d4d845b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:44.333346 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-8a9226c6-08c8-4bd8-b0ce-e8ab6d4d845b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:44.343919 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-8a9226c6-08c8-4bd8-b0ce-e8ab6d4d845b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1523 microversion: 2.1 time: 0.298090 Jul 25 23:05:44.344500 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 116/225] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:44 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1523 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:44.479520 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-77e0e6c6-11b6-4d44-99ac-32baabc23725 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Flavor limits 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 23:05:44.480379 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-77e0e6c6-11b6-4d44-99ac-32baabc23725 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Image limits 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 23:05:44.480902 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-77e0e6c6-11b6-4d44-99ac-32baabc23725 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Flavor pref 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 23:05:44.481498 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-77e0e6c6-11b6-4d44-99ac-32baabc23725 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Image pref 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 23:05:44.482060 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-77e0e6c6-11b6-4d44-99ac-32baabc23725 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 23:05:44.506124 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-77e0e6c6-11b6-4d44-99ac-32baabc23725 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:44.507155 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-77e0e6c6-11b6-4d44-99ac-32baabc23725 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:44.509213 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-77e0e6c6-11b6-4d44-99ac-32baabc23725 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:44.510318 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-77e0e6c6-11b6-4d44-99ac-32baabc23725 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:44.530249 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-77e0e6c6-11b6-4d44-99ac-32baabc23725 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Getting quotas for project d0af93f7c6b54114b0e1b5c32e3bf623. Resources: {'instances', 'cores', 'ram'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 23:05:44.535055 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-77e0e6c6-11b6-4d44-99ac-32baabc23725 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Getting quotas for user 2c4c72b9c83a4967b57b6633f9934dd4 and project d0af93f7c6b54114b0e1b5c32e3bf623. Resources: {'instances', 'cores', 'ram'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 23:05:44.550649 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-77e0e6c6-11b6-4d44-99ac-32baabc23725 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Going to run 1 instances... {{(pid=118409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 23:05:44.553018 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-77e0e6c6-11b6-4d44-99ac-32baabc23725 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f30166fb-cee4-499c-a6aa-988275e98c3b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 23:05:44.732442 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-77e0e6c6-11b6-4d44-99ac-32baabc23725 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.013031 Jul 25 23:05:44.739379 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 110/226] 10.222.0.55 () {60 vars in 1147 bytes} [Mon Jul 25 23:05:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1021 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 23:05:44.746631 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-908c6e1b-fde5-4d9d-9147-9e84bb740371 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:44.747124 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-908c6e1b-fde5-4d9d-9147-9e84bb740371 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:44.828537 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-908c6e1b-fde5-4d9d-9147-9e84bb740371 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:44.836662 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-908c6e1b-fde5-4d9d-9147-9e84bb740371 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1257 microversion: 2.1 time: 0.096072 Jul 25 23:05:44.841571 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 117/227] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:44 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1257 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:45.367127 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-475b7f9b-1bdc-4f2c-a60b-ede83c9e524a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:45.368690 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-475b7f9b-1bdc-4f2c-a60b-ede83c9e524a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:45.377844 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-475b7f9b-1bdc-4f2c-a60b-ede83c9e524a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:45.378282 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-475b7f9b-1bdc-4f2c-a60b-ede83c9e524a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:45.379228 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-475b7f9b-1bdc-4f2c-a60b-ede83c9e524a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:45.379660 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-475b7f9b-1bdc-4f2c-a60b-ede83c9e524a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:45.528007 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-475b7f9b-1bdc-4f2c-a60b-ede83c9e524a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:45.539108 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-475b7f9b-1bdc-4f2c-a60b-ede83c9e524a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1523 microversion: 2.1 time: 0.176955 Jul 25 23:05:45.556653 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 111/228] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:45 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:45.863088 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-565926de-4ea9-4fd3-8aec-ccaef882e36e tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:45.865854 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-565926de-4ea9-4fd3-8aec-ccaef882e36e tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:45.954272 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-565926de-4ea9-4fd3-8aec-ccaef882e36e tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:45.963392 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-565926de-4ea9-4fd3-8aec-ccaef882e36e tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1257 microversion: 2.1 time: 0.103434 Jul 25 23:05:45.964837 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 118/229] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:45 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1257 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:46.562463 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-a96b9a0e-e432-4b61-9200-db7d472a68e1 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:46.563338 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-a96b9a0e-e432-4b61-9200-db7d472a68e1 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:46.571376 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a96b9a0e-e432-4b61-9200-db7d472a68e1 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:46.571726 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a96b9a0e-e432-4b61-9200-db7d472a68e1 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:46.573799 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a96b9a0e-e432-4b61-9200-db7d472a68e1 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:46.574369 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a96b9a0e-e432-4b61-9200-db7d472a68e1 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:46.738432 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-a96b9a0e-e432-4b61-9200-db7d472a68e1 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:46.767239 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-a96b9a0e-e432-4b61-9200-db7d472a68e1 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1523 microversion: 2.1 time: 0.209200 Jul 25 23:05:46.767844 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 112/230] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:46 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1523 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:46.991875 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-569ba857-f94b-4674-9539-cd51272f103e tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:46.992615 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-569ba857-f94b-4674-9539-cd51272f103e tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:47.001107 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-569ba857-f94b-4674-9539-cd51272f103e tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:47.001107 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-569ba857-f94b-4674-9539-cd51272f103e tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:47.001107 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-569ba857-f94b-4674-9539-cd51272f103e tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:47.001421 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-569ba857-f94b-4674-9539-cd51272f103e tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:47.067396 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-569ba857-f94b-4674-9539-cd51272f103e tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:47.076458 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-569ba857-f94b-4674-9539-cd51272f103e tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1253 microversion: 2.1 time: 0.088813 Jul 25 23:05:47.079483 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 119/231] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:46 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1253 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:47.789526 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-26ea694c-b8e0-4438-b0f6-9a4d9f5e4b87 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:47.791442 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-26ea694c-b8e0-4438-b0f6-9a4d9f5e4b87 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:47.799677 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-26ea694c-b8e0-4438-b0f6-9a4d9f5e4b87 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:47.800436 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-26ea694c-b8e0-4438-b0f6-9a4d9f5e4b87 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:47.802304 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-26ea694c-b8e0-4438-b0f6-9a4d9f5e4b87 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:47.803124 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-26ea694c-b8e0-4438-b0f6-9a4d9f5e4b87 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:47.995037 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-26ea694c-b8e0-4438-b0f6-9a4d9f5e4b87 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:48.005330 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-26ea694c-b8e0-4438-b0f6-9a4d9f5e4b87 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1523 microversion: 2.1 time: 0.219524 Jul 25 23:05:48.006951 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 113/232] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:47 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:48.107393 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5d72238c-03da-48c0-818a-03a643cf5228 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:48.108025 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-5d72238c-03da-48c0-818a-03a643cf5228 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:48.115171 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5d72238c-03da-48c0-818a-03a643cf5228 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:48.116014 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5d72238c-03da-48c0-818a-03a643cf5228 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:48.117007 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5d72238c-03da-48c0-818a-03a643cf5228 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:48.118285 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5d72238c-03da-48c0-818a-03a643cf5228 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:48.184085 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-5d72238c-03da-48c0-818a-03a643cf5228 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:48.194824 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-5d72238c-03da-48c0-818a-03a643cf5228 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1327 microversion: 2.1 time: 0.090714 Jul 25 23:05:48.194824 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 120/233] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:48 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1327 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:49.036293 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-6635f956-5e0f-493d-bc5f-1ee6b3041497 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:49.036914 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-6635f956-5e0f-493d-bc5f-1ee6b3041497 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:49.044326 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6635f956-5e0f-493d-bc5f-1ee6b3041497 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:49.044771 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6635f956-5e0f-493d-bc5f-1ee6b3041497 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:49.053857 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6635f956-5e0f-493d-bc5f-1ee6b3041497 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:49.054945 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6635f956-5e0f-493d-bc5f-1ee6b3041497 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:49.216332 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0c0f75f1-6b9e-4ef2-8830-17c8e868efcc tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:49.217773 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-0c0f75f1-6b9e-4ef2-8830-17c8e868efcc tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:49.226653 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0c0f75f1-6b9e-4ef2-8830-17c8e868efcc tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:49.227922 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0c0f75f1-6b9e-4ef2-8830-17c8e868efcc tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:49.231035 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0c0f75f1-6b9e-4ef2-8830-17c8e868efcc tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:49.231786 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0c0f75f1-6b9e-4ef2-8830-17c8e868efcc tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:49.315740 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-6635f956-5e0f-493d-bc5f-1ee6b3041497 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:49.341889 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-6635f956-5e0f-493d-bc5f-1ee6b3041497 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1523 microversion: 2.1 time: 0.318439 Jul 25 23:05:49.357489 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 114/234] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:49 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1523 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:49.517832 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-0c0f75f1-6b9e-4ef2-8830-17c8e868efcc tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:49.566561 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-0c0f75f1-6b9e-4ef2-8830-17c8e868efcc tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1357 microversion: 2.1 time: 0.348629 Jul 25 23:05:49.584555 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 121/235] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:49 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1357 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:05:50.373933 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-628a4b1d-d00c-4d48-8c76-d5e6d78c680f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:50.374567 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-628a4b1d-d00c-4d48-8c76-d5e6d78c680f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:50.375582 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-2a20908f-e8d8-4923-a026-d212b645d7ec tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:50.376224 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-2a20908f-e8d8-4923-a026-d212b645d7ec tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:50.387112 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-628a4b1d-d00c-4d48-8c76-d5e6d78c680f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:50.387569 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-628a4b1d-d00c-4d48-8c76-d5e6d78c680f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:50.393422 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-628a4b1d-d00c-4d48-8c76-d5e6d78c680f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:50.393422 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-628a4b1d-d00c-4d48-8c76-d5e6d78c680f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:50.399895 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2a20908f-e8d8-4923-a026-d212b645d7ec tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:50.400355 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2a20908f-e8d8-4923-a026-d212b645d7ec tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:50.409763 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2a20908f-e8d8-4923-a026-d212b645d7ec tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:50.410447 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2a20908f-e8d8-4923-a026-d212b645d7ec tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:50.427437 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-628a4b1d-d00c-4d48-8c76-d5e6d78c680f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d/ips" status: 200 len: 146 microversion: 2.1 time: 0.086451 Jul 25 23:05:50.428980 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 115/236] 10.222.0.55 () {58 vars in 1248 bytes} [Mon Jul 25 23:05:50 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d/ips => generated 146 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:05:50.597482 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-34972968-6fa8-49f0-88f9-968f0449b5c9 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:50.597482 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-34972968-6fa8-49f0-88f9-968f0449b5c9 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:50.609818 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-34972968-6fa8-49f0-88f9-968f0449b5c9 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:50.616625 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-34972968-6fa8-49f0-88f9-968f0449b5c9 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:50.616625 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-34972968-6fa8-49f0-88f9-968f0449b5c9 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:50.616625 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-34972968-6fa8-49f0-88f9-968f0449b5c9 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:51.000697 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-2a20908f-e8d8-4923-a026-d212b645d7ec tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:51.013774 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-2a20908f-e8d8-4923-a026-d212b645d7ec tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1523 microversion: 2.1 time: 0.648582 Jul 25 23:05:51.014790 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 122/237] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:50 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1523 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:51.023727 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-34972968-6fa8-49f0-88f9-968f0449b5c9 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:51.023986 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-4f850da1-cf9a-4638-81e1-80d8bc6ecdd5 req-2f2800d1-4752-42a2-84b4-5f99dad1c5b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "231ce093-ad72-4ed1-b3aa-f4f87da18ed8", "tag": "65c4e82d-ddb3-40b6-9509-99191d55da54"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:05:51.033459 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-34972968-6fa8-49f0-88f9-968f0449b5c9 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1357 microversion: 2.1 time: 0.445007 Jul 25 23:05:51.034026 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 116/238] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:50 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1357 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:51.037033 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-4f850da1-cf9a-4638-81e1-80d8bc6ecdd5 req-2f2800d1-4752-42a2-84b4-5f99dad1c5b2 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:51.037536 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-4f850da1-cf9a-4638-81e1-80d8bc6ecdd5 req-2f2800d1-4752-42a2-84b4-5f99dad1c5b2 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:51.049604 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-4f850da1-cf9a-4638-81e1-80d8bc6ecdd5 req-2f2800d1-4752-42a2-84b4-5f99dad1c5b2 service nova] Creating event network-changed:65c4e82d-ddb3-40b6-9509-99191d55da54 for instance 231ce093-ad72-4ed1-b3aa-f4f87da18ed8 on hv-cinder-79760 Jul 25 23:05:51.054761 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-4f850da1-cf9a-4638-81e1-80d8bc6ecdd5 req-2f2800d1-4752-42a2-84b4-5f99dad1c5b2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036155 Jul 25 23:05:51.055966 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 123/239] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:05:52.035915 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-1737c123-f12c-478e-b1cb-29443ebaeca6 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:52.036593 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-1737c123-f12c-478e-b1cb-29443ebaeca6 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:52.052419 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1737c123-f12c-478e-b1cb-29443ebaeca6 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:52.057379 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b4989781-2443-490a-b6ef-df346ebb3ce3 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:52.057897 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1737c123-f12c-478e-b1cb-29443ebaeca6 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:52.058646 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1737c123-f12c-478e-b1cb-29443ebaeca6 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:52.058831 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b4989781-2443-490a-b6ef-df346ebb3ce3 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:52.059089 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1737c123-f12c-478e-b1cb-29443ebaeca6 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:52.065844 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b4989781-2443-490a-b6ef-df346ebb3ce3 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:52.066302 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b4989781-2443-490a-b6ef-df346ebb3ce3 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:52.067066 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b4989781-2443-490a-b6ef-df346ebb3ce3 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:52.067504 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b4989781-2443-490a-b6ef-df346ebb3ce3 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:52.328349 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-1737c123-f12c-478e-b1cb-29443ebaeca6 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:52.341354 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-1737c123-f12c-478e-b1cb-29443ebaeca6 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1523 microversion: 2.1 time: 0.309927 Jul 25 23:05:52.342622 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 117/240] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:52 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1523 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:52.434065 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b4989781-2443-490a-b6ef-df346ebb3ce3 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:52.449670 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b4989781-2443-490a-b6ef-df346ebb3ce3 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1357 microversion: 2.1 time: 0.396690 Jul 25 23:05:52.449670 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 124/241] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:52 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1357 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:05:52.918934 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-48fa5cd4-86b3-4e38-aa7e-aeff1ed637a7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:52.919875 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-48fa5cd4-86b3-4e38-aa7e-aeff1ed637a7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:52.930792 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-48fa5cd4-86b3-4e38-aa7e-aeff1ed637a7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:52.930792 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-48fa5cd4-86b3-4e38-aa7e-aeff1ed637a7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:52.930792 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-48fa5cd4-86b3-4e38-aa7e-aeff1ed637a7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:52.930792 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-48fa5cd4-86b3-4e38-aa7e-aeff1ed637a7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:52.966904 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-48fa5cd4-86b3-4e38-aa7e-aeff1ed637a7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33/ips" status: 200 len: 152 microversion: 2.20 time: 0.052843 Jul 25 23:05:52.967577 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 118/242] 10.222.0.55 () {60 vars in 1289 bytes} [Mon Jul 25 23:05:52 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33/ips => generated 152 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 23:05:53.363498 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b144160e-ff69-4fce-bd6b-ce6dd1ffcfc2 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:53.364648 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b144160e-ff69-4fce-bd6b-ce6dd1ffcfc2 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:53.374481 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b144160e-ff69-4fce-bd6b-ce6dd1ffcfc2 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:53.375135 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b144160e-ff69-4fce-bd6b-ce6dd1ffcfc2 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:53.376092 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b144160e-ff69-4fce-bd6b-ce6dd1ffcfc2 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:53.376673 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b144160e-ff69-4fce-bd6b-ce6dd1ffcfc2 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:53.479641 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-0b340399-11eb-43d7-a5b0-174f569f5371 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:53.479641 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-0b340399-11eb-43d7-a5b0-174f569f5371 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:53.515871 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0b340399-11eb-43d7-a5b0-174f569f5371 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:53.515871 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0b340399-11eb-43d7-a5b0-174f569f5371 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:53.515871 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0b340399-11eb-43d7-a5b0-174f569f5371 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:53.515871 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0b340399-11eb-43d7-a5b0-174f569f5371 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:53.629812 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b144160e-ff69-4fce-bd6b-ce6dd1ffcfc2 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:53.643434 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b144160e-ff69-4fce-bd6b-ce6dd1ffcfc2 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1523 microversion: 2.1 time: 0.283825 Jul 25 23:05:53.644769 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 125/243] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:53 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1523 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:53.809848 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b6cdb0d4-61d2-43e2-9abc-e7341574b381 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae9b41da-1105-48c0-a1e0-3e78f73ca1ae"}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:05:53.821495 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-0b340399-11eb-43d7-a5b0-174f569f5371 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:53.824336 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b6cdb0d4-61d2-43e2-9abc-e7341574b381 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:53.837252 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-0b340399-11eb-43d7-a5b0-174f569f5371 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1357 microversion: 2.1 time: 0.372393 Jul 25 23:05:53.838221 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 119/244] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:53 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1357 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:53.848263 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b6cdb0d4-61d2-43e2-9abc-e7341574b381 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:53.849188 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b6cdb0d4-61d2-43e2-9abc-e7341574b381 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:53.850233 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b6cdb0d4-61d2-43e2-9abc-e7341574b381 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:53.850820 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b6cdb0d4-61d2-43e2-9abc-e7341574b381 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:54.667003 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-8ede2db0-2311-419a-b41a-9293d9acc226 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:54.667863 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-8ede2db0-2311-419a-b41a-9293d9acc226 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:54.671554 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell0:SELECT=2 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:54.674223 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell0:SELECT=6 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:54.683881 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8ede2db0-2311-419a-b41a-9293d9acc226 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:54.684448 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8ede2db0-2311-419a-b41a-9293d9acc226 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:54.685280 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8ede2db0-2311-419a-b41a-9293d9acc226 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:54.687696 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8ede2db0-2311-419a-b41a-9293d9acc226 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:54.976213 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-8ede2db0-2311-419a-b41a-9293d9acc226 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:54.997237 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-8ede2db0-2311-419a-b41a-9293d9acc226 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1523 microversion: 2.1 time: 0.329301 Jul 25 23:05:55.001807 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 120/245] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:54 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1523 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:55.012252 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-f08bc535-41ae-4430-8c2d-98002fa047ff tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:55.013171 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-f08bc535-41ae-4430-8c2d-98002fa047ff tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:55.029831 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f08bc535-41ae-4430-8c2d-98002fa047ff tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:55.029831 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f08bc535-41ae-4430-8c2d-98002fa047ff tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:55.029831 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f08bc535-41ae-4430-8c2d-98002fa047ff tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:55.029831 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f08bc535-41ae-4430-8c2d-98002fa047ff tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:55.221931 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-f08bc535-41ae-4430-8c2d-98002fa047ff tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:55.230833 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-f08bc535-41ae-4430-8c2d-98002fa047ff tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1357 microversion: 2.1 time: 0.227836 Jul 25 23:05:55.231430 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 121/246] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:55 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1357 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:55.962012 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=8 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:56.018797 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-a0f6ad9b-7e18-4303-9108-539851682d33 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:56.019774 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-a0f6ad9b-7e18-4303-9108-539851682d33 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:56.032074 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a0f6ad9b-7e18-4303-9108-539851682d33 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:56.032813 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a0f6ad9b-7e18-4303-9108-539851682d33 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:56.034503 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a0f6ad9b-7e18-4303-9108-539851682d33 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:56.035472 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a0f6ad9b-7e18-4303-9108-539851682d33 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:56.090684 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=100 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:56.312111 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-a0f6ad9b-7e18-4303-9108-539851682d33 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:56.321363 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-a0f6ad9b-7e18-4303-9108-539851682d33 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1523 microversion: 2.1 time: 0.309357 Jul 25 23:05:56.332775 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 122/247] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:56 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1523 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:05:56.340192 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-cb7cb632-b00d-49e9-8dd8-8b8be5755655 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:05:56.340596 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-cb7cb632-b00d-49e9-8dd8-8b8be5755655 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:56.357599 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cb7cb632-b00d-49e9-8dd8-8b8be5755655 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:56.358142 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cb7cb632-b00d-49e9-8dd8-8b8be5755655 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:56.359766 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cb7cb632-b00d-49e9-8dd8-8b8be5755655 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:56.360380 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cb7cb632-b00d-49e9-8dd8-8b8be5755655 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:56.398538 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.objects.instance [None req-cb7cb632-b00d-49e9-8dd8-8b8be5755655 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lazy-loading 'flavor' on Instance uuid e78f6354-b88d-45a6-817b-4ef206d07d33 {{(pid=118409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 23:05:57.053747 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-cb7cb632-b00d-49e9-8dd8-8b8be5755655 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "POST /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33/action" status: 202 len: 0 microversion: 2.20 time: 0.726409 Jul 25 23:05:57.055206 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 123/248] 10.222.0.55 () {62 vars in 1319 bytes} [Mon Jul 25 23:05:56 2022] POST /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33/action => generated 0 bytes in 729 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 23:05:57.070671 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-15e7b8df-4bd2-451c-9fa0-feb13f54ddf3 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:57.071376 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-15e7b8df-4bd2-451c-9fa0-feb13f54ddf3 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:57.083306 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-15e7b8df-4bd2-451c-9fa0-feb13f54ddf3 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:57.083976 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-15e7b8df-4bd2-451c-9fa0-feb13f54ddf3 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:57.084932 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-15e7b8df-4bd2-451c-9fa0-feb13f54ddf3 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:57.085546 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-15e7b8df-4bd2-451c-9fa0-feb13f54ddf3 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:57.267076 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-15e7b8df-4bd2-451c-9fa0-feb13f54ddf3 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:57.279578 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-15e7b8df-4bd2-451c-9fa0-feb13f54ddf3 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1357 microversion: 2.1 time: 0.221632 Jul 25 23:05:57.284337 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 124/249] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:57 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1357 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:57.289916 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-281e7cfa-3069-4056-9efa-841561643925 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:57.294219 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-281e7cfa-3069-4056-9efa-841561643925 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:57.315939 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-281e7cfa-3069-4056-9efa-841561643925 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:57.324236 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-281e7cfa-3069-4056-9efa-841561643925 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:57.324236 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-281e7cfa-3069-4056-9efa-841561643925 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:57.324236 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-281e7cfa-3069-4056-9efa-841561643925 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:57.651500 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-281e7cfa-3069-4056-9efa-841561643925 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:57.660039 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-281e7cfa-3069-4056-9efa-841561643925 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:57.661990 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-281e7cfa-3069-4056-9efa-841561643925 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:57.663470 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-281e7cfa-3069-4056-9efa-841561643925 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1724 microversion: 2.20 time: 0.377902 Jul 25 23:05:57.679925 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 125/250] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:05:57 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1724 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:05:57.687210 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-636e468e-5396-4aa2-8b01-5717cd486b39 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:57.688174 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-636e468e-5396-4aa2-8b01-5717cd486b39 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:57.695577 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-636e468e-5396-4aa2-8b01-5717cd486b39 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:57.696502 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-636e468e-5396-4aa2-8b01-5717cd486b39 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:57.697561 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-636e468e-5396-4aa2-8b01-5717cd486b39 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:57.698210 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-636e468e-5396-4aa2-8b01-5717cd486b39 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:57.991619 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-636e468e-5396-4aa2-8b01-5717cd486b39 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:58.004016 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-636e468e-5396-4aa2-8b01-5717cd486b39 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1523 microversion: 2.1 time: 0.321510 Jul 25 23:05:58.004617 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 126/251] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:57 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1523 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:58.303935 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-19e6a87b-d1c0-4f3e-a38f-1e06a754443d tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:58.305719 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-19e6a87b-d1c0-4f3e-a38f-1e06a754443d tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:58.314475 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-19e6a87b-d1c0-4f3e-a38f-1e06a754443d tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:58.315201 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-19e6a87b-d1c0-4f3e-a38f-1e06a754443d tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:58.316308 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-19e6a87b-d1c0-4f3e-a38f-1e06a754443d tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:58.316919 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-19e6a87b-d1c0-4f3e-a38f-1e06a754443d tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:58.624467 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-19e6a87b-d1c0-4f3e-a38f-1e06a754443d tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:58.635527 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-19e6a87b-d1c0-4f3e-a38f-1e06a754443d tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1357 microversion: 2.1 time: 0.333467 Jul 25 23:05:58.653175 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 127/252] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:58 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1357 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:05:58.698322 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-dc7abec3-ab7f-4e53-bbca-e94047edaaf5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:58.702375 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-dc7abec3-ab7f-4e53-bbca-e94047edaaf5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:58.718261 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-dc7abec3-ab7f-4e53-bbca-e94047edaaf5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:58.718799 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-dc7abec3-ab7f-4e53-bbca-e94047edaaf5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:58.719658 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-dc7abec3-ab7f-4e53-bbca-e94047edaaf5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:58.720363 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-dc7abec3-ab7f-4e53-bbca-e94047edaaf5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:58.835754 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:05:58.911374 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-dc7abec3-ab7f-4e53-bbca-e94047edaaf5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:58.922844 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-dc7abec3-ab7f-4e53-bbca-e94047edaaf5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:58.927712 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-dc7abec3-ab7f-4e53-bbca-e94047edaaf5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:58.934242 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-dc7abec3-ab7f-4e53-bbca-e94047edaaf5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1724 microversion: 2.20 time: 0.244912 Jul 25 23:05:58.937362 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 128/253] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:05:58 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:05:59.027003 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-528fe2a0-05af-4f5a-920d-e1a5e957b962 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:59.027597 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-528fe2a0-05af-4f5a-920d-e1a5e957b962 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:59.031715 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b6cdb0d4-61d2-43e2-9abc-e7341574b381 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "POST /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.226294 Jul 25 23:05:59.032466 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 126/254] 10.222.0.55 () {60 vars in 1323 bytes} [Mon Jul 25 23:05:53 2022] POST /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d/os-volume_attachments => generated 194 bytes in 5228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 23:05:59.033853 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-528fe2a0-05af-4f5a-920d-e1a5e957b962 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:59.034297 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-528fe2a0-05af-4f5a-920d-e1a5e957b962 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:59.035065 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-528fe2a0-05af-4f5a-920d-e1a5e957b962 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:59.035496 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-528fe2a0-05af-4f5a-920d-e1a5e957b962 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:59.177626 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-528fe2a0-05af-4f5a-920d-e1a5e957b962 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:59.186112 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-528fe2a0-05af-4f5a-920d-e1a5e957b962 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1523 microversion: 2.1 time: 0.163662 Jul 25 23:05:59.200066 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 129/255] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:59 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:05:59.660099 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c43717e7-8d20-4d79-a853-fa093e7cf834 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:59.660801 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c43717e7-8d20-4d79-a853-fa093e7cf834 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:59.674545 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c43717e7-8d20-4d79-a853-fa093e7cf834 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:59.675569 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c43717e7-8d20-4d79-a853-fa093e7cf834 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:59.676008 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c43717e7-8d20-4d79-a853-fa093e7cf834 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:59.676434 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c43717e7-8d20-4d79-a853-fa093e7cf834 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:59.834957 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c43717e7-8d20-4d79-a853-fa093e7cf834 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:05:59.844205 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c43717e7-8d20-4d79-a853-fa093e7cf834 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1357 microversion: 2.1 time: 0.189461 Jul 25 23:05:59.862925 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 127/256] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:05:59 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1357 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:05:59.958188 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-59dee1b7-d5af-468d-ab31-78b6a683f928 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:05:59.959018 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-59dee1b7-d5af-468d-ab31-78b6a683f928 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:05:59.971987 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-59dee1b7-d5af-468d-ab31-78b6a683f928 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:59.975558 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-59dee1b7-d5af-468d-ab31-78b6a683f928 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:05:59.977818 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-59dee1b7-d5af-468d-ab31-78b6a683f928 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:05:59.979415 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-59dee1b7-d5af-468d-ab31-78b6a683f928 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:00.207155 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6706e1a4-37ed-470d-b0cd-0d38e3e0477f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:00.207837 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6706e1a4-37ed-470d-b0cd-0d38e3e0477f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:00.221350 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6706e1a4-37ed-470d-b0cd-0d38e3e0477f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:00.222056 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6706e1a4-37ed-470d-b0cd-0d38e3e0477f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:00.224944 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6706e1a4-37ed-470d-b0cd-0d38e3e0477f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:00.225642 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6706e1a4-37ed-470d-b0cd-0d38e3e0477f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:00.256012 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-59dee1b7-d5af-468d-ab31-78b6a683f928 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:00.265486 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-59dee1b7-d5af-468d-ab31-78b6a683f928 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:00.267094 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-59dee1b7-d5af-468d-ab31-78b6a683f928 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:00.268354 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-59dee1b7-d5af-468d-ab31-78b6a683f928 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1724 microversion: 2.20 time: 0.314360 Jul 25 23:06:00.268970 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 130/257] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:05:59 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1724 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:06:00.393593 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6706e1a4-37ed-470d-b0cd-0d38e3e0477f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:00.402091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6706e1a4-37ed-470d-b0cd-0d38e3e0477f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1523 microversion: 2.1 time: 0.198708 Jul 25 23:06:00.402695 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 128/258] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:00 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:00.868114 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-a20cba51-9579-4b12-baed-c1be19a661b7 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:00.868777 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-a20cba51-9579-4b12-baed-c1be19a661b7 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:00.877240 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a20cba51-9579-4b12-baed-c1be19a661b7 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:00.879844 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a20cba51-9579-4b12-baed-c1be19a661b7 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:00.879844 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a20cba51-9579-4b12-baed-c1be19a661b7 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:00.879844 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a20cba51-9579-4b12-baed-c1be19a661b7 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:01.234185 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-a20cba51-9579-4b12-baed-c1be19a661b7 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:01.243278 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-a20cba51-9579-4b12-baed-c1be19a661b7 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1357 microversion: 2.1 time: 0.379112 Jul 25 23:06:01.244042 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 131/259] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:00 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1357 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:01.294014 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-fd0a5886-a962-4637-864b-93c2badc8b0e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:01.294711 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-fd0a5886-a962-4637-864b-93c2badc8b0e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:01.311580 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fd0a5886-a962-4637-864b-93c2badc8b0e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:01.312156 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fd0a5886-a962-4637-864b-93c2badc8b0e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:01.313059 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fd0a5886-a962-4637-864b-93c2badc8b0e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:01.314141 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fd0a5886-a962-4637-864b-93c2badc8b0e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:01.423854 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-01a086a7-3baa-452c-8262-849c88357905 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:01.424705 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-01a086a7-3baa-452c-8262-849c88357905 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:01.431814 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-01a086a7-3baa-452c-8262-849c88357905 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:01.432360 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-01a086a7-3baa-452c-8262-849c88357905 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:01.433390 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-01a086a7-3baa-452c-8262-849c88357905 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:01.433831 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-01a086a7-3baa-452c-8262-849c88357905 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:01.464384 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-fd0a5886-a962-4637-864b-93c2badc8b0e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:01.472713 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-fd0a5886-a962-4637-864b-93c2badc8b0e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:01.474255 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-fd0a5886-a962-4637-864b-93c2badc8b0e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:01.475921 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-fd0a5886-a962-4637-864b-93c2badc8b0e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1724 microversion: 2.20 time: 0.187213 Jul 25 23:06:01.477983 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 129/260] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:01 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:06:01.573409 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-01a086a7-3baa-452c-8262-849c88357905 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:01.580922 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-01a086a7-3baa-452c-8262-849c88357905 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1503 microversion: 2.1 time: 0.161015 Jul 25 23:06:01.581590 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 132/261] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:01 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:01.603098 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-12e722d7-9fcb-499c-8db3-7e5afd12ad0a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75ca2bbf-a39a-4de8-9e6e-d539d5e48305"}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:06:01.605490 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-12e722d7-9fcb-499c-8db3-7e5afd12ad0a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:01.613501 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-12e722d7-9fcb-499c-8db3-7e5afd12ad0a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:01.614045 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-12e722d7-9fcb-499c-8db3-7e5afd12ad0a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:01.614837 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-12e722d7-9fcb-499c-8db3-7e5afd12ad0a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:01.618080 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-12e722d7-9fcb-499c-8db3-7e5afd12ad0a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:01.639912 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-12e722d7-9fcb-499c-8db3-7e5afd12ad0a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] HTTP exception thrown: Cannot 'attach_volume' instance f79f5efc-af32-4b3a-975a-aef5b386752f while it is in vm_state rescued Jul 25 23:06:01.641723 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-12e722d7-9fcb-499c-8db3-7e5afd12ad0a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Request method failure captured: Jul 25 23:06:01.641723 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: request: POST /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f/os-volume_attachments HTTP/1.1 Jul 25 23:06:01.641723 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 25 23:06:01.641723 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 25 23:06:01.641723 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Connection: close Jul 25 23:06:01.641723 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Length: 74 Jul 25 23:06:01.641723 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 25 23:06:01.641723 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Host: 10.222.0.55 Jul 25 23:06:01.641723 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 25 23:06:01.641723 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.10 Jul 25 23:06:01.641723 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABi3yFhkq942vbXnch_IaDKYkO2a3M4yfpDeC2Egpsw0NkwonPh9rBHysX1VIkRqYsB6WQirLUD5WvUZeDdUAXg7TkjmCnSiBSzeoce0TNVhD0leQwr5enAPBpaGFXzPzZMM9NzAOwUv2fBV_BWwBxc9go1JkJZo0Dfjd7PPELR0ji1dFs Jul 25 23:06:01.641723 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 25 23:06:01.641723 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 25 23:06:01.641723 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 25 23:06:01.641723 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 25 23:06:01.641723 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 25 23:06:01.641723 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 25 23:06:01.641723 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Id: d37d3446345749b28d847313e1e6c488 Jul 25 23:06:01.641723 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1178072060 Jul 25 23:06:01.641723 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Role: reader,member Jul 25 23:06:01.641723 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Roles: reader,member Jul 25 23:06:01.646843 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d37d3446345749b28d847313e1e6c488"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d37d3446345749b28d847313e1e6c488"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d37d3446345749b28d847313e1e6c488", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d37d3446345749b28d847313e1e6c488"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:06:01.646843 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1178072060 Jul 25 23:06:01.646843 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Id: d37d3446345749b28d847313e1e6c488 Jul 25 23:06:01.646843 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1178072060 Jul 25 23:06:01.646843 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User: tempest-ServerRescueNegativeTestJSON-1178072060-project Jul 25 23:06:01.646843 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 25 23:06:01.646843 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 25 23:06:01.646843 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Id: 61d3b5a3082a4c74a2a08007581388c0 Jul 25 23:06:01.646843 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1178072060-project Jul 25 23:06:01.646843 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Jul 25 23:06:01.646843 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: {"volumeAttachment": {"volumeId": "75ca2bbf-a39a-4de8-9e6e-d539d5e48305"}} Jul 25 23:06:01.646843 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: method: > Jul 25 23:06:01.648028 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: exception: Cannot 'attach_volume' instance f79f5efc-af32-4b3a-975a-aef5b386752f while it is in vm_state rescued Jul 25 23:06:01.648028 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: action_args: {'server_id': 'f79f5efc-af32-4b3a-975a-aef5b386752f', 'body': {'volumeAttachment': {'volumeId': '75ca2bbf-a39a-4de8-9e6e-d539d5e48305'}}} Jul 25 23:06:01.648028 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:06:01.648028 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:06:01.648028 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 23:06:01.648028 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 23:06:01.648028 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 23:06:01.648028 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 23:06:01.648028 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 23:06:01.648028 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 23:06:01.648028 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f79f5efc-af32-4b3a-975a-aef5b386752f in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 25 23:06:01.648028 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:06:01.648028 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:06:01.648028 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:06:01.648028 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:06:01.648028 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:06:01.648028 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:06:01.648028 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:06:01.648028 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:06:01.650070 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:06:01.650070 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:06:01.650070 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 23:06:01.650070 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 23:06:01.650070 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 23:06:01.650070 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 23:06:01.650070 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 23:06:01.650070 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 23:06:01.650070 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 25 23:06:01.650070 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 23:06:01.650070 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 23:06:01.650070 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 23:06:01.650070 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f79f5efc-af32-4b3a-975a-aef5b386752f while it is in vm_state rescued Jul 25 23:06:01.650070 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:06:01.650070 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:06:01.650070 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:06:01.650070 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:06:01.650070 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:06:01.650070 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:06:01.651575 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:06:01.651575 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:06:01.651575 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f79f5efc-af32-4b3a-975a-aef5b386752f while it is in vm_state rescued Jul 25 23:06:01.651575 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:06:01.651575 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-12e722d7-9fcb-499c-8db3-7e5afd12ad0a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Returning 409 to user: Cannot 'attach_volume' instance f79f5efc-af32-4b3a-975a-aef5b386752f while it is in vm_state rescued {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:06:01.651575 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-12e722d7-9fcb-499c-8db3-7e5afd12ad0a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "POST /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.045138 Jul 25 23:06:01.651575 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 130/262] 10.222.0.55 () {60 vars in 1323 bytes} [Mon Jul 25 23:06:01 2022] POST /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 25 23:06:01.656379 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-3f1dc336-5031-43bf-8574-bad7bf903499 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:06:01.656979 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-3f1dc336-5031-43bf-8574-bad7bf903499 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:01.663056 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3f1dc336-5031-43bf-8574-bad7bf903499 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:01.663502 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3f1dc336-5031-43bf-8574-bad7bf903499 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:01.665427 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3f1dc336-5031-43bf-8574-bad7bf903499 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:01.665568 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3f1dc336-5031-43bf-8574-bad7bf903499 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:01.898797 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-3f1dc336-5031-43bf-8574-bad7bf903499 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "POST /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f/action" status: 202 len: 0 microversion: 2.1 time: 0.246433 Jul 25 23:06:01.900149 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 133/263] 10.222.0.55 () {60 vars in 1278 bytes} [Mon Jul 25 23:06:01 2022] POST /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 23:06:01.909821 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-7cd3fc23-719b-4a5f-90e1-f900668692a7 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:01.910450 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-7cd3fc23-719b-4a5f-90e1-f900668692a7 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:01.912402 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:01.917945 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7cd3fc23-719b-4a5f-90e1-f900668692a7 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:01.918388 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7cd3fc23-719b-4a5f-90e1-f900668692a7 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:01.919180 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7cd3fc23-719b-4a5f-90e1-f900668692a7 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:01.919613 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7cd3fc23-719b-4a5f-90e1-f900668692a7 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:02.077533 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7cd3fc23-719b-4a5f-90e1-f900668692a7 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:02.085102 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-7cd3fc23-719b-4a5f-90e1-f900668692a7 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1511 microversion: 2.1 time: 0.179077 Jul 25 23:06:02.085691 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 131/264] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:01 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1511 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:02.266912 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-5e9333e5-8e0c-4acb-992c-78d4f7cfb9e4 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:02.268201 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-5e9333e5-8e0c-4acb-992c-78d4f7cfb9e4 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:02.288145 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5e9333e5-8e0c-4acb-992c-78d4f7cfb9e4 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:02.288145 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5e9333e5-8e0c-4acb-992c-78d4f7cfb9e4 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:02.288145 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5e9333e5-8e0c-4acb-992c-78d4f7cfb9e4 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:02.288145 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5e9333e5-8e0c-4acb-992c-78d4f7cfb9e4 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:02.423922 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-5e9333e5-8e0c-4acb-992c-78d4f7cfb9e4 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:02.431738 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-5e9333e5-8e0c-4acb-992c-78d4f7cfb9e4 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1357 microversion: 2.1 time: 0.170214 Jul 25 23:06:02.432544 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 134/265] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:02 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:02.500775 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-267f253f-b371-446e-9dd2-54df6713cb4f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:02.501372 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-267f253f-b371-446e-9dd2-54df6713cb4f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:02.508728 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-267f253f-b371-446e-9dd2-54df6713cb4f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:02.509198 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-267f253f-b371-446e-9dd2-54df6713cb4f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:02.509968 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-267f253f-b371-446e-9dd2-54df6713cb4f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:02.510403 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-267f253f-b371-446e-9dd2-54df6713cb4f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:02.645197 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-267f253f-b371-446e-9dd2-54df6713cb4f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:02.654169 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-267f253f-b371-446e-9dd2-54df6713cb4f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:02.655667 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-267f253f-b371-446e-9dd2-54df6713cb4f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:02.656880 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-267f253f-b371-446e-9dd2-54df6713cb4f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1724 microversion: 2.20 time: 0.160355 Jul 25 23:06:02.657392 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 132/266] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:02 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:06:03.107655 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-771d80d2-9caa-4ce2-ae6b-ad5476388438 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:03.108438 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-771d80d2-9caa-4ce2-ae6b-ad5476388438 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:03.110585 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:03.115540 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-771d80d2-9caa-4ce2-ae6b-ad5476388438 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:03.116054 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-771d80d2-9caa-4ce2-ae6b-ad5476388438 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:03.116912 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-771d80d2-9caa-4ce2-ae6b-ad5476388438 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:03.118066 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-771d80d2-9caa-4ce2-ae6b-ad5476388438 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:03.260475 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-771d80d2-9caa-4ce2-ae6b-ad5476388438 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:03.264237 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-771d80d2-9caa-4ce2-ae6b-ad5476388438 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1511 microversion: 2.1 time: 0.160455 Jul 25 23:06:03.264821 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 135/267] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:03 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:03.453348 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-1b41fec6-f556-49ac-a3ad-5e60681602b7 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:03.454035 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-1b41fec6-f556-49ac-a3ad-5e60681602b7 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:03.460745 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1b41fec6-f556-49ac-a3ad-5e60681602b7 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:03.461687 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1b41fec6-f556-49ac-a3ad-5e60681602b7 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:03.462461 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1b41fec6-f556-49ac-a3ad-5e60681602b7 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:03.463057 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1b41fec6-f556-49ac-a3ad-5e60681602b7 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:03.597257 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-1b41fec6-f556-49ac-a3ad-5e60681602b7 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:03.605419 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-1b41fec6-f556-49ac-a3ad-5e60681602b7 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1357 microversion: 2.1 time: 0.157315 Jul 25 23:06:03.605985 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 133/268] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:03 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:03.680709 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-3055f1a6-908a-4137-84a6-a15162146c5d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:03.681355 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-3055f1a6-908a-4137-84a6-a15162146c5d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:03.687976 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3055f1a6-908a-4137-84a6-a15162146c5d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:03.688420 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3055f1a6-908a-4137-84a6-a15162146c5d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:03.689205 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3055f1a6-908a-4137-84a6-a15162146c5d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:03.689641 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3055f1a6-908a-4137-84a6-a15162146c5d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:03.693779 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:03.821916 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-3055f1a6-908a-4137-84a6-a15162146c5d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:03.830122 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-3055f1a6-908a-4137-84a6-a15162146c5d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:03.834877 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-3055f1a6-908a-4137-84a6-a15162146c5d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:03.834877 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-3055f1a6-908a-4137-84a6-a15162146c5d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1724 microversion: 2.20 time: 0.156920 Jul 25 23:06:03.834877 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 136/269] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:03 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:06:04.293831 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4b618387-d52e-46a9-904d-d4285a2e9ece tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:04.294466 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4b618387-d52e-46a9-904d-d4285a2e9ece tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:04.300557 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4b618387-d52e-46a9-904d-d4285a2e9ece tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:04.301007 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4b618387-d52e-46a9-904d-d4285a2e9ece tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:04.302063 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4b618387-d52e-46a9-904d-d4285a2e9ece tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:04.302501 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4b618387-d52e-46a9-904d-d4285a2e9ece tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:04.437687 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4b618387-d52e-46a9-904d-d4285a2e9ece tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:04.445453 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4b618387-d52e-46a9-904d-d4285a2e9ece tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1511 microversion: 2.1 time: 0.156124 Jul 25 23:06:04.446112 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 134/270] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:04 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:04.627089 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-92672e85-c184-4feb-910f-308ed7f1125a tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:04.627740 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-92672e85-c184-4feb-910f-308ed7f1125a tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:04.635244 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-92672e85-c184-4feb-910f-308ed7f1125a tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:04.635630 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-92672e85-c184-4feb-910f-308ed7f1125a tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:04.636419 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-92672e85-c184-4feb-910f-308ed7f1125a tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:04.636827 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-92672e85-c184-4feb-910f-308ed7f1125a tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:04.771021 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-92672e85-c184-4feb-910f-308ed7f1125a tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:04.779387 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-92672e85-c184-4feb-910f-308ed7f1125a tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1357 microversion: 2.1 time: 0.156469 Jul 25 23:06:04.779958 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 137/271] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:04 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:04.856067 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4390860e-3b17-48bf-abac-ef76092056b3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:04.856664 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4390860e-3b17-48bf-abac-ef76092056b3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:04.863364 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4390860e-3b17-48bf-abac-ef76092056b3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:04.863815 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4390860e-3b17-48bf-abac-ef76092056b3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:04.864583 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4390860e-3b17-48bf-abac-ef76092056b3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:04.865014 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4390860e-3b17-48bf-abac-ef76092056b3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:05.043460 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4390860e-3b17-48bf-abac-ef76092056b3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:05.051591 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4390860e-3b17-48bf-abac-ef76092056b3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:05.053069 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4390860e-3b17-48bf-abac-ef76092056b3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:05.054231 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4390860e-3b17-48bf-abac-ef76092056b3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1724 microversion: 2.20 time: 0.202409 Jul 25 23:06:05.055438 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 135/272] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:04 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:06:05.467065 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-cf0f7643-e3fa-46b8-84a2-e695da33f24f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:05.472462 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-cf0f7643-e3fa-46b8-84a2-e695da33f24f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:05.474455 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cf0f7643-e3fa-46b8-84a2-e695da33f24f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:05.474998 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cf0f7643-e3fa-46b8-84a2-e695da33f24f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:05.475769 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cf0f7643-e3fa-46b8-84a2-e695da33f24f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:05.476226 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cf0f7643-e3fa-46b8-84a2-e695da33f24f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:05.612396 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-cf0f7643-e3fa-46b8-84a2-e695da33f24f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:05.620944 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-cf0f7643-e3fa-46b8-84a2-e695da33f24f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1511 microversion: 2.1 time: 0.157899 Jul 25 23:06:05.621540 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 138/273] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:05 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1511 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:05.799981 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-575855b5-4489-4ae7-9546-2f1d7634ed01 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:05.800582 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-575855b5-4489-4ae7-9546-2f1d7634ed01 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:05.807429 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-575855b5-4489-4ae7-9546-2f1d7634ed01 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:05.807864 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-575855b5-4489-4ae7-9546-2f1d7634ed01 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:05.808618 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-575855b5-4489-4ae7-9546-2f1d7634ed01 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:05.809048 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-575855b5-4489-4ae7-9546-2f1d7634ed01 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:06.020532 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-575855b5-4489-4ae7-9546-2f1d7634ed01 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:06.030166 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-575855b5-4489-4ae7-9546-2f1d7634ed01 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1357 microversion: 2.1 time: 0.234020 Jul 25 23:06:06.030742 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 136/274] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:05 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1357 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:06.079264 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-57688dd6-d86d-4fc6-bd74-02fdd8c3cd8e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:06.080736 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-57688dd6-d86d-4fc6-bd74-02fdd8c3cd8e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:06.088090 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-57688dd6-d86d-4fc6-bd74-02fdd8c3cd8e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:06.088540 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-57688dd6-d86d-4fc6-bd74-02fdd8c3cd8e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:06.089349 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-57688dd6-d86d-4fc6-bd74-02fdd8c3cd8e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:06.089965 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-57688dd6-d86d-4fc6-bd74-02fdd8c3cd8e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:06.231946 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-57688dd6-d86d-4fc6-bd74-02fdd8c3cd8e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:06.240238 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-57688dd6-d86d-4fc6-bd74-02fdd8c3cd8e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:06.241761 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-57688dd6-d86d-4fc6-bd74-02fdd8c3cd8e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:06.242955 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-57688dd6-d86d-4fc6-bd74-02fdd8c3cd8e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1724 microversion: 2.20 time: 0.167635 Jul 25 23:06:06.243897 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 139/275] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:06 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:06:06.647642 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-126c912d-8c85-4143-9994-e1cd28a7f48a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:06.650104 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-126c912d-8c85-4143-9994-e1cd28a7f48a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:06.682340 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-126c912d-8c85-4143-9994-e1cd28a7f48a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:06.684487 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-126c912d-8c85-4143-9994-e1cd28a7f48a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:06.685605 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-126c912d-8c85-4143-9994-e1cd28a7f48a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:06.686232 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-126c912d-8c85-4143-9994-e1cd28a7f48a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:06.983405 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-126c912d-8c85-4143-9994-e1cd28a7f48a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:06.991126 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-126c912d-8c85-4143-9994-e1cd28a7f48a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1511 microversion: 2.1 time: 0.350973 Jul 25 23:06:06.991689 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 137/276] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:06 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1511 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:07.052311 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-f206c3c0-f8bd-4e89-b388-d221ffca9fae tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:07.053071 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-f206c3c0-f8bd-4e89-b388-d221ffca9fae tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:07.059545 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f206c3c0-f8bd-4e89-b388-d221ffca9fae tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:07.060176 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f206c3c0-f8bd-4e89-b388-d221ffca9fae tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:07.060952 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f206c3c0-f8bd-4e89-b388-d221ffca9fae tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:07.061422 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f206c3c0-f8bd-4e89-b388-d221ffca9fae tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:07.197737 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-f206c3c0-f8bd-4e89-b388-d221ffca9fae tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:07.205714 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-f206c3c0-f8bd-4e89-b388-d221ffca9fae tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1357 microversion: 2.1 time: 0.157618 Jul 25 23:06:07.216384 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 140/277] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:07 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:07.272428 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-986418fe-cf16-410a-8c3e-d129f5b901d7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:07.273157 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-986418fe-cf16-410a-8c3e-d129f5b901d7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:07.280058 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-986418fe-cf16-410a-8c3e-d129f5b901d7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:07.280491 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-986418fe-cf16-410a-8c3e-d129f5b901d7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:07.281267 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-986418fe-cf16-410a-8c3e-d129f5b901d7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:07.281690 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-986418fe-cf16-410a-8c3e-d129f5b901d7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:07.426922 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-986418fe-cf16-410a-8c3e-d129f5b901d7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:07.438228 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-986418fe-cf16-410a-8c3e-d129f5b901d7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:07.439453 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-986418fe-cf16-410a-8c3e-d129f5b901d7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:07.440931 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-986418fe-cf16-410a-8c3e-d129f5b901d7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1724 microversion: 2.20 time: 0.172186 Jul 25 23:06:07.441904 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 138/278] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:07 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:06:07.742217 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-4158f14e-90ae-4112-a364-a6db3d6233eb req-8cb068f3-e771-43e9-b4a5-edbc481aaa6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "231ce093-ad72-4ed1-b3aa-f4f87da18ed8", "name": "network-vif-plugged", "status": "completed", "tag": "65c4e82d-ddb3-40b6-9509-99191d55da54"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:06:07.752640 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-4158f14e-90ae-4112-a364-a6db3d6233eb req-8cb068f3-e771-43e9-b4a5-edbc481aaa6c service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:07.753091 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-4158f14e-90ae-4112-a364-a6db3d6233eb req-8cb068f3-e771-43e9-b4a5-edbc481aaa6c service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:07.766270 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-4158f14e-90ae-4112-a364-a6db3d6233eb req-8cb068f3-e771-43e9-b4a5-edbc481aaa6c service nova] Creating event network-vif-plugged:65c4e82d-ddb3-40b6-9509-99191d55da54 for instance 231ce093-ad72-4ed1-b3aa-f4f87da18ed8 on hv-cinder-79760 Jul 25 23:06:07.771307 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-4158f14e-90ae-4112-a364-a6db3d6233eb req-8cb068f3-e771-43e9-b4a5-edbc481aaa6c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032785 Jul 25 23:06:07.771875 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 141/279] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:06:08.012661 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-9a79567e-463e-4cab-ba01-12e6000170f5 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:08.013330 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-9a79567e-463e-4cab-ba01-12e6000170f5 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:08.019746 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9a79567e-463e-4cab-ba01-12e6000170f5 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:08.020186 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9a79567e-463e-4cab-ba01-12e6000170f5 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:08.020940 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9a79567e-463e-4cab-ba01-12e6000170f5 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:08.021393 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9a79567e-463e-4cab-ba01-12e6000170f5 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:08.160466 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9a79567e-463e-4cab-ba01-12e6000170f5 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:08.168272 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-9a79567e-463e-4cab-ba01-12e6000170f5 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1511 microversion: 2.1 time: 0.160181 Jul 25 23:06:08.168927 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 139/280] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:08 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1511 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:08.227754 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-c144414b-0241-455d-9899-07559d9329ff tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:08.228448 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-c144414b-0241-455d-9899-07559d9329ff tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:08.234624 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c144414b-0241-455d-9899-07559d9329ff tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:08.235316 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c144414b-0241-455d-9899-07559d9329ff tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:08.236165 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c144414b-0241-455d-9899-07559d9329ff tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:08.236601 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c144414b-0241-455d-9899-07559d9329ff tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:08.377232 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-c144414b-0241-455d-9899-07559d9329ff tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:08.385405 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-c144414b-0241-455d-9899-07559d9329ff tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1357 microversion: 2.1 time: 0.162358 Jul 25 23:06:08.385979 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 142/281] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:08 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:08.466558 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d22259a0-a0fe-4a44-90bb-25e9fb1578b9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:08.467752 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-d22259a0-a0fe-4a44-90bb-25e9fb1578b9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:08.482111 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d22259a0-a0fe-4a44-90bb-25e9fb1578b9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:08.482111 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d22259a0-a0fe-4a44-90bb-25e9fb1578b9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:08.482111 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d22259a0-a0fe-4a44-90bb-25e9fb1578b9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:08.482111 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d22259a0-a0fe-4a44-90bb-25e9fb1578b9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:08.615180 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-d22259a0-a0fe-4a44-90bb-25e9fb1578b9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:08.624010 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-d22259a0-a0fe-4a44-90bb-25e9fb1578b9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:08.625594 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-d22259a0-a0fe-4a44-90bb-25e9fb1578b9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:08.626687 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-d22259a0-a0fe-4a44-90bb-25e9fb1578b9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1724 microversion: 2.20 time: 0.164664 Jul 25 23:06:08.627553 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 140/282] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:08 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:06:09.191253 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-65ad8cad-d6de-412d-a491-22ffffde322a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:09.191837 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-65ad8cad-d6de-412d-a491-22ffffde322a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:09.198513 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-65ad8cad-d6de-412d-a491-22ffffde322a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:09.198957 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-65ad8cad-d6de-412d-a491-22ffffde322a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:09.199710 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-65ad8cad-d6de-412d-a491-22ffffde322a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:09.200332 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-65ad8cad-d6de-412d-a491-22ffffde322a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:09.337821 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-65ad8cad-d6de-412d-a491-22ffffde322a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:09.345821 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-65ad8cad-d6de-412d-a491-22ffffde322a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1511 microversion: 2.1 time: 0.158469 Jul 25 23:06:09.346408 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 143/283] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:09 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:09.467160 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-db5b3620-996d-4441-b650-c584517d3ee9 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:09.467697 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-db5b3620-996d-4441-b650-c584517d3ee9 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:09.474334 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-db5b3620-996d-4441-b650-c584517d3ee9 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:09.474800 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-db5b3620-996d-4441-b650-c584517d3ee9 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:09.475515 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-db5b3620-996d-4441-b650-c584517d3ee9 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:09.478530 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-db5b3620-996d-4441-b650-c584517d3ee9 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:09.612490 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-db5b3620-996d-4441-b650-c584517d3ee9 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:09.621842 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-db5b3620-996d-4441-b650-c584517d3ee9 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1357 microversion: 2.1 time: 0.158686 Jul 25 23:06:09.622421 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 141/284] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:09 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:06:09.650385 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-7f02fe1f-ca4e-4a41-b80a-9c3f14538c0c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:09.651258 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-7f02fe1f-ca4e-4a41-b80a-9c3f14538c0c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:09.657325 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7f02fe1f-ca4e-4a41-b80a-9c3f14538c0c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:09.657775 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7f02fe1f-ca4e-4a41-b80a-9c3f14538c0c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:09.658539 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7f02fe1f-ca4e-4a41-b80a-9c3f14538c0c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:09.658968 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7f02fe1f-ca4e-4a41-b80a-9c3f14538c0c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:09.788200 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-7f02fe1f-ca4e-4a41-b80a-9c3f14538c0c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:09.796226 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-7f02fe1f-ca4e-4a41-b80a-9c3f14538c0c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:09.797784 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-7f02fe1f-ca4e-4a41-b80a-9c3f14538c0c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:09.798934 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-7f02fe1f-ca4e-4a41-b80a-9c3f14538c0c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1724 microversion: 2.20 time: 0.152952 Jul 25 23:06:09.799491 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 144/285] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:09 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:06:10.368570 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5dedc91d-8605-4293-8f8c-e3b42043f10a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:10.369200 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-5dedc91d-8605-4293-8f8c-e3b42043f10a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:10.375402 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5dedc91d-8605-4293-8f8c-e3b42043f10a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:10.380730 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5dedc91d-8605-4293-8f8c-e3b42043f10a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:10.380730 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5dedc91d-8605-4293-8f8c-e3b42043f10a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:10.380730 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5dedc91d-8605-4293-8f8c-e3b42043f10a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:10.514498 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-5dedc91d-8605-4293-8f8c-e3b42043f10a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:10.522079 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-5dedc91d-8605-4293-8f8c-e3b42043f10a tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1511 microversion: 2.1 time: 0.158031 Jul 25 23:06:10.527101 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 142/286] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:10 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:10.643813 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-55e336f9-4217-4437-a1e8-70062c4e525f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:10.644339 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-55e336f9-4217-4437-a1e8-70062c4e525f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:10.650933 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-55e336f9-4217-4437-a1e8-70062c4e525f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:10.651637 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-55e336f9-4217-4437-a1e8-70062c4e525f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:10.652409 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-55e336f9-4217-4437-a1e8-70062c4e525f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:10.652845 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-55e336f9-4217-4437-a1e8-70062c4e525f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:10.782006 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-55e336f9-4217-4437-a1e8-70062c4e525f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:10.789276 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-55e336f9-4217-4437-a1e8-70062c4e525f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1357 microversion: 2.1 time: 0.149439 Jul 25 23:06:10.790339 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 145/287] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:10 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:10.822669 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-84ade143-bfdb-45e4-a31e-dcb607a79f65 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:10.823264 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-84ade143-bfdb-45e4-a31e-dcb607a79f65 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:10.829366 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-84ade143-bfdb-45e4-a31e-dcb607a79f65 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:10.829810 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-84ade143-bfdb-45e4-a31e-dcb607a79f65 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:10.830578 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-84ade143-bfdb-45e4-a31e-dcb607a79f65 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:10.830991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-84ade143-bfdb-45e4-a31e-dcb607a79f65 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:10.834952 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:10.969519 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-84ade143-bfdb-45e4-a31e-dcb607a79f65 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:10.977922 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-84ade143-bfdb-45e4-a31e-dcb607a79f65 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:10.979449 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-84ade143-bfdb-45e4-a31e-dcb607a79f65 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:10.980583 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-84ade143-bfdb-45e4-a31e-dcb607a79f65 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1724 microversion: 2.20 time: 0.162013 Jul 25 23:06:10.981142 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 143/288] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:10 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:06:11.544046 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-07a6678c-3242-4304-ae2d-f7365125ad46 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:11.544633 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-07a6678c-3242-4304-ae2d-f7365125ad46 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:11.550746 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-07a6678c-3242-4304-ae2d-f7365125ad46 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:11.551190 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-07a6678c-3242-4304-ae2d-f7365125ad46 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:11.551943 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-07a6678c-3242-4304-ae2d-f7365125ad46 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:11.552372 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-07a6678c-3242-4304-ae2d-f7365125ad46 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:11.681628 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-07a6678c-3242-4304-ae2d-f7365125ad46 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:11.690096 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-07a6678c-3242-4304-ae2d-f7365125ad46 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1517 microversion: 2.1 time: 0.150095 Jul 25 23:06:11.690842 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 146/289] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:11 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:11.814298 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d2215ee0-4168-481f-b1bb-9bf1e24af081 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:11.816109 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-d2215ee0-4168-481f-b1bb-9bf1e24af081 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:11.826790 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d2215ee0-4168-481f-b1bb-9bf1e24af081 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:11.827234 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d2215ee0-4168-481f-b1bb-9bf1e24af081 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:11.828227 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d2215ee0-4168-481f-b1bb-9bf1e24af081 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:11.828657 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d2215ee0-4168-481f-b1bb-9bf1e24af081 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:11.982436 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-d2215ee0-4168-481f-b1bb-9bf1e24af081 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:11.990733 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-d2215ee0-4168-481f-b1bb-9bf1e24af081 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1357 microversion: 2.1 time: 0.183231 Jul 25 23:06:11.991635 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 144/290] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:11 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:12.004089 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-959cf7e7-c44c-4070-acca-ea7977e11462 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:12.004941 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-959cf7e7-c44c-4070-acca-ea7977e11462 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:12.012401 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-959cf7e7-c44c-4070-acca-ea7977e11462 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:12.012841 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-959cf7e7-c44c-4070-acca-ea7977e11462 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:12.013640 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-959cf7e7-c44c-4070-acca-ea7977e11462 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:12.014070 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-959cf7e7-c44c-4070-acca-ea7977e11462 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:12.165394 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-959cf7e7-c44c-4070-acca-ea7977e11462 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:12.173525 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-959cf7e7-c44c-4070-acca-ea7977e11462 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:12.175038 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-959cf7e7-c44c-4070-acca-ea7977e11462 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:12.176185 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-959cf7e7-c44c-4070-acca-ea7977e11462 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1724 microversion: 2.20 time: 0.176166 Jul 25 23:06:12.176734 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 147/291] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:11 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:06:12.935386 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-25790ed2-381a-45cd-bf6d-f12e639fbd40 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:06:12.939478 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-25790ed2-381a-45cd-bf6d-f12e639fbd40 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:12.940045 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-25790ed2-381a-45cd-bf6d-f12e639fbd40 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:13.002677 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-25790ed2-381a-45cd-bf6d-f12e639fbd40 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Going to try to stop instance {{(pid=118410) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 23:06:13.012129 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-29b4585e-0fde-460e-be16-c4920a7cfadc tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:13.012728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-29b4585e-0fde-460e-be16-c4920a7cfadc tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:13.019573 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-29b4585e-0fde-460e-be16-c4920a7cfadc tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:13.019996 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-29b4585e-0fde-460e-be16-c4920a7cfadc tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:13.020759 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-29b4585e-0fde-460e-be16-c4920a7cfadc tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:13.021280 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-29b4585e-0fde-460e-be16-c4920a7cfadc tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:13.162196 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-29b4585e-0fde-460e-be16-c4920a7cfadc tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:13.170387 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-29b4585e-0fde-460e-be16-c4920a7cfadc tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1357 microversion: 2.1 time: 0.162043 Jul 25 23:06:13.170965 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 148/292] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:13 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:06:13.199385 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-b5d6c1b4-ceee-448d-ae85-e8d7fab47b17 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:13.200021 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-b5d6c1b4-ceee-448d-ae85-e8d7fab47b17 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:13.206810 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b5d6c1b4-ceee-448d-ae85-e8d7fab47b17 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:13.207255 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b5d6c1b4-ceee-448d-ae85-e8d7fab47b17 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:13.208029 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b5d6c1b4-ceee-448d-ae85-e8d7fab47b17 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:13.208458 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b5d6c1b4-ceee-448d-ae85-e8d7fab47b17 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:13.349694 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-25790ed2-381a-45cd-bf6d-f12e639fbd40 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "POST /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d/action" status: 202 len: 0 microversion: 2.1 time: 0.422697 Jul 25 23:06:13.350653 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 145/293] 10.222.0.55 () {60 vars in 1278 bytes} [Mon Jul 25 23:06:12 2022] POST /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d/action => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 23:06:13.360814 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-9473dbf3-3caf-4b81-8593-8b439a9ceddc tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:13.361050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-b5d6c1b4-ceee-448d-ae85-e8d7fab47b17 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:13.362024 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-9473dbf3-3caf-4b81-8593-8b439a9ceddc tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:13.371062 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9473dbf3-3caf-4b81-8593-8b439a9ceddc tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:13.371683 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9473dbf3-3caf-4b81-8593-8b439a9ceddc tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:13.372575 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9473dbf3-3caf-4b81-8593-8b439a9ceddc tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:13.373244 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9473dbf3-3caf-4b81-8593-8b439a9ceddc tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:13.373408 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-b5d6c1b4-ceee-448d-ae85-e8d7fab47b17 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:13.378755 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-b5d6c1b4-ceee-448d-ae85-e8d7fab47b17 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:13.378755 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-b5d6c1b4-ceee-448d-ae85-e8d7fab47b17 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1724 microversion: 2.20 time: 0.181773 Jul 25 23:06:13.385544 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 149/294] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:13 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:06:13.520588 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9473dbf3-3caf-4b81-8593-8b439a9ceddc tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:13.530123 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-9473dbf3-3caf-4b81-8593-8b439a9ceddc tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1724 microversion: 2.1 time: 0.174251 Jul 25 23:06:13.530812 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 146/295] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:13 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:13.667895 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-ce83bed5-9c39-41a2-8361-ae4b15590e5e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Action: 'create', calling method: .version_select at 0x7f622c0164c0>, body: {"keypair": {"name": "tempest-keypair-193804980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNDpoFATdSsQQnMRUerQoeQGqaY7x5N2ipWa/tCUCFbMSINu+deZydf8jMucgeyGTLU0IcYpbB+OmTmIaQdRRLHh3bEL5hRU9F0OXr5C8aRR7lARnpAGljGNAvDPCs3ZJw=="}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:06:13.685424 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-ce83bed5-9c39-41a2-8361-ae4b15590e5e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Getting quotas for project d37d3446345749b28d847313e1e6c488. Resources: {'key_pairs'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 23:06:13.696513 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-ce83bed5-9c39-41a2-8361-ae4b15590e5e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Getting quotas for user 61d3b5a3082a4c74a2a08007581388c0 and project d37d3446345749b28d847313e1e6c488. Resources: {'key_pairs'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 23:06:13.770816 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-ce83bed5-9c39-41a2-8361-ae4b15590e5e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.107678 Jul 25 23:06:13.771507 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 150/296] 10.222.0.55 () {60 vars in 1159 bytes} [Mon Jul 25 23:06:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:06:14.192161 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-8aa809aa-bf51-4c9d-bcc4-8c02b288b638 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:14.192680 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-8aa809aa-bf51-4c9d-bcc4-8c02b288b638 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:14.200098 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8aa809aa-bf51-4c9d-bcc4-8c02b288b638 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:14.200537 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8aa809aa-bf51-4c9d-bcc4-8c02b288b638 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:14.201333 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8aa809aa-bf51-4c9d-bcc4-8c02b288b638 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:14.201776 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8aa809aa-bf51-4c9d-bcc4-8c02b288b638 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:14.337618 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-8aa809aa-bf51-4c9d-bcc4-8c02b288b638 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:14.345645 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-8aa809aa-bf51-4c9d-bcc4-8c02b288b638 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1547 microversion: 2.1 time: 0.157346 Jul 25 23:06:14.346219 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 147/297] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:14 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:14.367327 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-bc021416-b92f-470b-bdf5-68f7c28b15c6 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:14.368562 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-bc021416-b92f-470b-bdf5-68f7c28b15c6 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:14.375283 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-bc021416-b92f-470b-bdf5-68f7c28b15c6 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:14.375727 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-bc021416-b92f-470b-bdf5-68f7c28b15c6 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:14.376498 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-bc021416-b92f-470b-bdf5-68f7c28b15c6 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:14.376930 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-bc021416-b92f-470b-bdf5-68f7c28b15c6 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:14.403691 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-64f100b4-eb09-46a0-8db0-43f9e188f7e8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:14.404303 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-64f100b4-eb09-46a0-8db0-43f9e188f7e8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:14.411485 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-64f100b4-eb09-46a0-8db0-43f9e188f7e8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:14.412302 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-64f100b4-eb09-46a0-8db0-43f9e188f7e8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:14.416810 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-64f100b4-eb09-46a0-8db0-43f9e188f7e8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:14.416810 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-64f100b4-eb09-46a0-8db0-43f9e188f7e8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:14.577700 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-bc021416-b92f-470b-bdf5-68f7c28b15c6 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:14.584843 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-bc021416-b92f-470b-bdf5-68f7c28b15c6 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1547 microversion: 2.1 time: 0.221512 Jul 25 23:06:14.585764 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 151/298] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:14 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1547 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:06:14.590765 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-713e2915-755f-43a7-818b-c970933f120c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:14.591367 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-713e2915-755f-43a7-818b-c970933f120c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:14.597622 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-713e2915-755f-43a7-818b-c970933f120c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:14.598268 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-713e2915-755f-43a7-818b-c970933f120c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:14.599194 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-713e2915-755f-43a7-818b-c970933f120c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:14.599795 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-713e2915-755f-43a7-818b-c970933f120c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:14.617008 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-64f100b4-eb09-46a0-8db0-43f9e188f7e8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:14.626225 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-64f100b4-eb09-46a0-8db0-43f9e188f7e8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:14.627791 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-64f100b4-eb09-46a0-8db0-43f9e188f7e8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:14.629033 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-64f100b4-eb09-46a0-8db0-43f9e188f7e8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1724 microversion: 2.20 time: 0.231126 Jul 25 23:06:14.629673 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 148/299] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:14 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:06:14.636464 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-cefb1f71-e9e7-49a9-a334-e1fb7cfdac16 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:14.643587 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-cefb1f71-e9e7-49a9-a334-e1fb7cfdac16 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:14.647793 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-cefb1f71-e9e7-49a9-a334-e1fb7cfdac16 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Searching by: {'deleted': False, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623'} {{(pid=118410) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 25 23:06:14.653691 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cefb1f71-e9e7-49a9-a334-e1fb7cfdac16 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:14.654536 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cefb1f71-e9e7-49a9-a334-e1fb7cfdac16 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:14.655487 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cefb1f71-e9e7-49a9-a334-e1fb7cfdac16 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:14.656063 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cefb1f71-e9e7-49a9-a334-e1fb7cfdac16 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:14.756269 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.multi_cell_list [None req-cefb1f71-e9e7-49a9-a334-e1fb7cfdac16 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118410) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 25 23:06:14.768198 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-713e2915-755f-43a7-818b-c970933f120c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:14.777539 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-713e2915-755f-43a7-818b-c970933f120c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1724 microversion: 2.1 time: 0.190461 Jul 25 23:06:14.778278 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 152/300] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:14 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:14.868768 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-cefb1f71-e9e7-49a9-a334-e1fb7cfdac16 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.237147 Jul 25 23:06:14.869433 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 149/301] 10.222.0.55 () {58 vars in 1125 bytes} [Mon Jul 25 23:06:14 2022] GET /compute/v2.1/servers => generated 343 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:06:14.881074 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-9e990d9f-5de0-4182-8da5-a058b6b12e00 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:14.881732 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-9e990d9f-5de0-4182-8da5-a058b6b12e00 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:14.888599 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9e990d9f-5de0-4182-8da5-a058b6b12e00 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:14.889051 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9e990d9f-5de0-4182-8da5-a058b6b12e00 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:14.889912 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9e990d9f-5de0-4182-8da5-a058b6b12e00 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:14.890362 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9e990d9f-5de0-4182-8da5-a058b6b12e00 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:15.038758 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-9e990d9f-5de0-4182-8da5-a058b6b12e00 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:15.047081 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-9e990d9f-5de0-4182-8da5-a058b6b12e00 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1547 microversion: 2.1 time: 0.170007 Jul 25 23:06:15.047659 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 153/302] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:14 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1547 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:15.656118 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-ee0bbc7a-d126-4a7a-b7a5-3b4740adcd00 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:15.656867 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-ee0bbc7a-d126-4a7a-b7a5-3b4740adcd00 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:15.674042 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ee0bbc7a-d126-4a7a-b7a5-3b4740adcd00 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:15.675504 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ee0bbc7a-d126-4a7a-b7a5-3b4740adcd00 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:15.676694 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ee0bbc7a-d126-4a7a-b7a5-3b4740adcd00 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:15.677890 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ee0bbc7a-d126-4a7a-b7a5-3b4740adcd00 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:15.801324 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-0d5d08f1-721d-46e9-8b14-dff595e18417 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:15.801932 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-0d5d08f1-721d-46e9-8b14-dff595e18417 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:15.815467 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0d5d08f1-721d-46e9-8b14-dff595e18417 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:15.815937 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0d5d08f1-721d-46e9-8b14-dff595e18417 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:15.816726 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0d5d08f1-721d-46e9-8b14-dff595e18417 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:15.818285 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0d5d08f1-721d-46e9-8b14-dff595e18417 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:15.846454 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=100 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:15.978318 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ee0bbc7a-d126-4a7a-b7a5-3b4740adcd00 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:15.988442 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ee0bbc7a-d126-4a7a-b7a5-3b4740adcd00 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:15.993441 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ee0bbc7a-d126-4a7a-b7a5-3b4740adcd00 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:15.996872 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-ee0bbc7a-d126-4a7a-b7a5-3b4740adcd00 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1724 microversion: 2.20 time: 0.342741 Jul 25 23:06:15.997995 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 150/303] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:15 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1724 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:06:16.060414 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-0d5d08f1-721d-46e9-8b14-dff595e18417 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:16.068268 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-0d5d08f1-721d-46e9-8b14-dff595e18417 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1724 microversion: 2.1 time: 0.272080 Jul 25 23:06:16.069207 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 154/304] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:15 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1724 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:16.632279 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-70e316d1-ff5a-4bf6-b53e-bcea2c45f371 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-7489527", "imageRef": "8e9f3265-0fdf-483a-8e2e-41d408f5f0e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "caec5bff-5fb9-4c5c-a304-9aecc48aa721"}], "security_groups": [{"name": "tempest-securitygroup--1832818218"}], "key_name": "tempest-keypair-193804980", "user_data": "}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:06:16.740522 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.network.neutron [None req-70e316d1-ff5a-4bf6-b53e-bcea2c45f371 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] validate_networks() for [('caec5bff-5fb9-4c5c-a304-9aecc48aa721', None, None, None, None, None)] {{(pid=118410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 23:06:17.023809 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-ac5b0db1-7008-4b94-86b6-0371b8667ec5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:17.025273 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-ac5b0db1-7008-4b94-86b6-0371b8667ec5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:17.033034 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ac5b0db1-7008-4b94-86b6-0371b8667ec5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:17.033537 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ac5b0db1-7008-4b94-86b6-0371b8667ec5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:17.034366 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ac5b0db1-7008-4b94-86b6-0371b8667ec5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:17.034830 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ac5b0db1-7008-4b94-86b6-0371b8667ec5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:17.463545 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-ac5b0db1-7008-4b94-86b6-0371b8667ec5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:17.475717 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-70e316d1-ff5a-4bf6-b53e-bcea2c45f371 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Flavor limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 23:06:17.476136 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-70e316d1-ff5a-4bf6-b53e-bcea2c45f371 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Image limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 23:06:17.476640 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-70e316d1-ff5a-4bf6-b53e-bcea2c45f371 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Flavor pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 23:06:17.477669 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-70e316d1-ff5a-4bf6-b53e-bcea2c45f371 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Image pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 23:06:17.478131 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-70e316d1-ff5a-4bf6-b53e-bcea2c45f371 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 23:06:17.481749 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-ac5b0db1-7008-4b94-86b6-0371b8667ec5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:17.485649 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-ac5b0db1-7008-4b94-86b6-0371b8667ec5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:17.485649 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-ac5b0db1-7008-4b94-86b6-0371b8667ec5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1724 microversion: 2.20 time: 0.465352 Jul 25 23:06:17.488127 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-70e316d1-ff5a-4bf6-b53e-bcea2c45f371 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:17.488575 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-70e316d1-ff5a-4bf6-b53e-bcea2c45f371 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:17.489411 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-70e316d1-ff5a-4bf6-b53e-bcea2c45f371 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:17.489873 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-70e316d1-ff5a-4bf6-b53e-bcea2c45f371 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:17.496919 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 155/305] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:17 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1724 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:06:17.502172 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-72f0dc90-4429-44cd-91a6-8e7469a8270f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:17.502962 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-72f0dc90-4429-44cd-91a6-8e7469a8270f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:17.509218 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-72f0dc90-4429-44cd-91a6-8e7469a8270f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:17.509608 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-70e316d1-ff5a-4bf6-b53e-bcea2c45f371 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Getting quotas for project d37d3446345749b28d847313e1e6c488. Resources: {'instances', 'cores', 'ram'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 23:06:17.509715 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-72f0dc90-4429-44cd-91a6-8e7469a8270f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:17.510401 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-72f0dc90-4429-44cd-91a6-8e7469a8270f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:17.510839 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-72f0dc90-4429-44cd-91a6-8e7469a8270f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:17.513800 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-70e316d1-ff5a-4bf6-b53e-bcea2c45f371 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Getting quotas for user 61d3b5a3082a4c74a2a08007581388c0 and project d37d3446345749b28d847313e1e6c488. Resources: {'instances', 'cores', 'ram'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 23:06:17.524950 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-70e316d1-ff5a-4bf6-b53e-bcea2c45f371 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Going to run 1 instances... {{(pid=118410) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 23:06:17.527749 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-70e316d1-ff5a-4bf6-b53e-bcea2c45f371 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e9f3265-0fdf-483a-8e2e-41d408f5f0e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 23:06:17.643055 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-72f0dc90-4429-44cd-91a6-8e7469a8270f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:17.651414 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-72f0dc90-4429-44cd-91a6-8e7469a8270f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1724 microversion: 2.1 time: 0.152893 Jul 25 23:06:17.651984 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 156/306] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:17 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:17.656598 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-7be150c7-2cb5-475f-baac-cb16ae83c5ba tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ea13cfd-a984-4e7f-99e5-1c9c6a7b9677"}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:06:17.659009 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-7be150c7-2cb5-475f-baac-cb16ae83c5ba tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:17.665454 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7be150c7-2cb5-475f-baac-cb16ae83c5ba tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:17.665967 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7be150c7-2cb5-475f-baac-cb16ae83c5ba tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:17.666731 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7be150c7-2cb5-475f-baac-cb16ae83c5ba tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:17.667168 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7be150c7-2cb5-475f-baac-cb16ae83c5ba tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:17.745848 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-70e316d1-ff5a-4bf6-b53e-bcea2c45f371 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.117948 Jul 25 23:06:17.747091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 151/307] 10.222.0.55 () {60 vars in 1147 bytes} [Mon Jul 25 23:06:16 2022] POST /compute/v2.1/servers => generated 409 bytes in 1120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 23:06:17.762776 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-eabb6610-e765-40b6-af81-05ca2c14f8bb tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:17.763377 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-eabb6610-e765-40b6-af81-05ca2c14f8bb tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:17.824798 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-eabb6610-e765-40b6-af81-05ca2c14f8bb tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:17.832262 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-eabb6610-e765-40b6-af81-05ca2c14f8bb tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1242 microversion: 2.1 time: 0.075050 Jul 25 23:06:17.833238 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 152/308] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:17 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1242 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:18.508561 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-72b310d8-2679-4bcb-9858-5c0c14a41d00 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:18.509458 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-72b310d8-2679-4bcb-9858-5c0c14a41d00 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:18.515674 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-72b310d8-2679-4bcb-9858-5c0c14a41d00 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:18.516114 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-72b310d8-2679-4bcb-9858-5c0c14a41d00 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:18.516874 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-72b310d8-2679-4bcb-9858-5c0c14a41d00 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:18.517323 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-72b310d8-2679-4bcb-9858-5c0c14a41d00 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:18.653351 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-72b310d8-2679-4bcb-9858-5c0c14a41d00 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:18.661463 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-72b310d8-2679-4bcb-9858-5c0c14a41d00 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:18.663043 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-72b310d8-2679-4bcb-9858-5c0c14a41d00 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:18.664089 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-72b310d8-2679-4bcb-9858-5c0c14a41d00 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1745 microversion: 2.20 time: 0.160144 Jul 25 23:06:18.664944 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 153/309] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:18 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:06:18.673050 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-632173ea-dcdd-4f63-a154-cf20be108060 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:18.673679 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-632173ea-dcdd-4f63-a154-cf20be108060 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:18.685940 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-632173ea-dcdd-4f63-a154-cf20be108060 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:18.686392 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-632173ea-dcdd-4f63-a154-cf20be108060 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:18.687217 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-632173ea-dcdd-4f63-a154-cf20be108060 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:18.687654 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-632173ea-dcdd-4f63-a154-cf20be108060 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:18.832185 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-632173ea-dcdd-4f63-a154-cf20be108060 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:18.840526 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-632173ea-dcdd-4f63-a154-cf20be108060 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1724 microversion: 2.1 time: 0.171783 Jul 25 23:06:18.851466 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 154/310] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:18 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:18.857712 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e77ec87f-b376-4a46-a7bc-240ef7d5285b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:18.858688 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e77ec87f-b376-4a46-a7bc-240ef7d5285b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:18.865779 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-7be150c7-2cb5-475f-baac-cb16ae83c5ba tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "POST /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.211771 Jul 25 23:06:18.873151 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e77ec87f-b376-4a46-a7bc-240ef7d5285b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:18.873330 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 157/311] 10.222.0.55 () {60 vars in 1323 bytes} [Mon Jul 25 23:06:17 2022] POST /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8/os-volume_attachments => generated 194 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:06:18.873414 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e77ec87f-b376-4a46-a7bc-240ef7d5285b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:18.873414 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e77ec87f-b376-4a46-a7bc-240ef7d5285b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:18.873414 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e77ec87f-b376-4a46-a7bc-240ef7d5285b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:18.951744 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e77ec87f-b376-4a46-a7bc-240ef7d5285b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:18.951744 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e77ec87f-b376-4a46-a7bc-240ef7d5285b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1246 microversion: 2.1 time: 0.098241 Jul 25 23:06:18.951744 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 155/312] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:18 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1246 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:06:19.688837 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-f875b499-ac9f-402f-9fca-8e11fb35dcf0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:19.689548 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-f875b499-ac9f-402f-9fca-8e11fb35dcf0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:19.695660 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f875b499-ac9f-402f-9fca-8e11fb35dcf0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:19.696096 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f875b499-ac9f-402f-9fca-8e11fb35dcf0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:19.697513 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f875b499-ac9f-402f-9fca-8e11fb35dcf0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:19.697939 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f875b499-ac9f-402f-9fca-8e11fb35dcf0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:19.836410 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-f875b499-ac9f-402f-9fca-8e11fb35dcf0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:19.845941 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-f875b499-ac9f-402f-9fca-8e11fb35dcf0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:19.848121 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-f875b499-ac9f-402f-9fca-8e11fb35dcf0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:19.849836 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-f875b499-ac9f-402f-9fca-8e11fb35dcf0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1745 microversion: 2.20 time: 0.165773 Jul 25 23:06:19.850431 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 158/313] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:19 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:06:19.868465 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-37a8f6be-02b4-4102-9fc0-bc4df496be88 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:19.869736 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-37a8f6be-02b4-4102-9fc0-bc4df496be88 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:19.876728 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-37a8f6be-02b4-4102-9fc0-bc4df496be88 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:19.877206 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-37a8f6be-02b4-4102-9fc0-bc4df496be88 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:19.877987 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-37a8f6be-02b4-4102-9fc0-bc4df496be88 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:19.878417 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-37a8f6be-02b4-4102-9fc0-bc4df496be88 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:19.984855 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-564e363e-8f08-418f-af44-1d2d1b200530 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:19.986076 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-564e363e-8f08-418f-af44-1d2d1b200530 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:19.992486 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-564e363e-8f08-418f-af44-1d2d1b200530 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:19.994013 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-564e363e-8f08-418f-af44-1d2d1b200530 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:19.994939 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-564e363e-8f08-418f-af44-1d2d1b200530 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:19.995547 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-564e363e-8f08-418f-af44-1d2d1b200530 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:20.080362 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-37a8f6be-02b4-4102-9fc0-bc4df496be88 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:20.082394 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-564e363e-8f08-418f-af44-1d2d1b200530 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:20.090157 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-564e363e-8f08-418f-af44-1d2d1b200530 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1246 microversion: 2.1 time: 0.110625 Jul 25 23:06:20.091164 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 159/314] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:19 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1246 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:20.091831 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-37a8f6be-02b4-4102-9fc0-bc4df496be88 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1724 microversion: 2.1 time: 0.227172 Jul 25 23:06:20.093066 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 156/315] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:19 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:20.875453 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-b0eb7641-f5a8-42aa-ade9-7a388898fe1f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:20.876053 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-b0eb7641-f5a8-42aa-ade9-7a388898fe1f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:20.885211 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b0eb7641-f5a8-42aa-ade9-7a388898fe1f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:20.885927 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b0eb7641-f5a8-42aa-ade9-7a388898fe1f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:20.886785 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b0eb7641-f5a8-42aa-ade9-7a388898fe1f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:20.887218 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b0eb7641-f5a8-42aa-ade9-7a388898fe1f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:21.034708 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-b0eb7641-f5a8-42aa-ade9-7a388898fe1f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:21.044591 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-b0eb7641-f5a8-42aa-ade9-7a388898fe1f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:21.046171 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-b0eb7641-f5a8-42aa-ade9-7a388898fe1f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:21.047667 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-b0eb7641-f5a8-42aa-ade9-7a388898fe1f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1745 microversion: 2.20 time: 0.176357 Jul 25 23:06:21.061730 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 160/316] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:20 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1745 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:06:21.113932 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-59b92719-d409-49b6-a702-f9376b6ecb56 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:21.119456 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-2e89f786-fb2f-441a-94d0-de169fea7a69 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:21.119635 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-59b92719-d409-49b6-a702-f9376b6ecb56 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:21.120058 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-2e89f786-fb2f-441a-94d0-de169fea7a69 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:21.126594 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-59b92719-d409-49b6-a702-f9376b6ecb56 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:21.126782 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2e89f786-fb2f-441a-94d0-de169fea7a69 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:21.127028 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-59b92719-d409-49b6-a702-f9376b6ecb56 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:21.127214 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2e89f786-fb2f-441a-94d0-de169fea7a69 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:21.127799 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-59b92719-d409-49b6-a702-f9376b6ecb56 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:21.127983 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2e89f786-fb2f-441a-94d0-de169fea7a69 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:21.128253 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-59b92719-d409-49b6-a702-f9376b6ecb56 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:21.128441 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2e89f786-fb2f-441a-94d0-de169fea7a69 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:21.215124 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-59b92719-d409-49b6-a702-f9376b6ecb56 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:21.227134 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-59b92719-d409-49b6-a702-f9376b6ecb56 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1246 microversion: 2.1 time: 0.119807 Jul 25 23:06:21.227774 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 157/317] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:21 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1246 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:21.293299 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-2e89f786-fb2f-441a-94d0-de169fea7a69 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:21.303291 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-2e89f786-fb2f-441a-94d0-de169fea7a69 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1724 microversion: 2.1 time: 0.189743 Jul 25 23:06:21.304519 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 161/318] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:21 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:22.076904 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-baed5989-74ee-4221-989f-3bcb631a8c9d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:22.078358 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-baed5989-74ee-4221-989f-3bcb631a8c9d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:22.089157 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-baed5989-74ee-4221-989f-3bcb631a8c9d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:22.089993 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-baed5989-74ee-4221-989f-3bcb631a8c9d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:22.091235 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-baed5989-74ee-4221-989f-3bcb631a8c9d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:22.091974 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-baed5989-74ee-4221-989f-3bcb631a8c9d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:22.248447 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-c18207ec-2e1b-4b72-aeed-1beaaefcac86 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:22.249800 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-c18207ec-2e1b-4b72-aeed-1beaaefcac86 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:22.258601 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c18207ec-2e1b-4b72-aeed-1beaaefcac86 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:22.259693 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c18207ec-2e1b-4b72-aeed-1beaaefcac86 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:22.264005 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c18207ec-2e1b-4b72-aeed-1beaaefcac86 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:22.264631 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c18207ec-2e1b-4b72-aeed-1beaaefcac86 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:22.338736 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-baed5989-74ee-4221-989f-3bcb631a8c9d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:22.356958 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-baed5989-74ee-4221-989f-3bcb631a8c9d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:22.362081 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-baed5989-74ee-4221-989f-3bcb631a8c9d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:22.367571 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-baed5989-74ee-4221-989f-3bcb631a8c9d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1745 microversion: 2.20 time: 0.295906 Jul 25 23:06:22.371421 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 158/319] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:22 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1745 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:06:22.381564 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-063dec7b-af5c-499c-802e-52b8f7b01c6a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:22.382518 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-063dec7b-af5c-499c-802e-52b8f7b01c6a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:22.391048 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-063dec7b-af5c-499c-802e-52b8f7b01c6a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:22.391896 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-063dec7b-af5c-499c-802e-52b8f7b01c6a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:22.392834 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-063dec7b-af5c-499c-802e-52b8f7b01c6a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:22.393444 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-063dec7b-af5c-499c-802e-52b8f7b01c6a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:22.417643 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-c18207ec-2e1b-4b72-aeed-1beaaefcac86 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:22.428060 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-c18207ec-2e1b-4b72-aeed-1beaaefcac86 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1238 microversion: 2.1 time: 0.183127 Jul 25 23:06:22.430164 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 162/320] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:22 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1238 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:22.595592 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-063dec7b-af5c-499c-802e-52b8f7b01c6a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:22.605096 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-063dec7b-af5c-499c-802e-52b8f7b01c6a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1724 microversion: 2.1 time: 0.227446 Jul 25 23:06:22.606335 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 159/321] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:22 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:23.404371 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-bd172310-aa05-423a-8db8-2be0de76f9ea tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:23.405099 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-bd172310-aa05-423a-8db8-2be0de76f9ea tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:23.420966 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-bd172310-aa05-423a-8db8-2be0de76f9ea tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:23.421449 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-bd172310-aa05-423a-8db8-2be0de76f9ea tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:23.428481 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-bd172310-aa05-423a-8db8-2be0de76f9ea tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:23.429166 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-bd172310-aa05-423a-8db8-2be0de76f9ea tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:23.451911 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-ad380c33-1af3-4d06-8e53-b0fef714c864 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:23.453924 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-ad380c33-1af3-4d06-8e53-b0fef714c864 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:23.465437 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ad380c33-1af3-4d06-8e53-b0fef714c864 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:23.466231 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ad380c33-1af3-4d06-8e53-b0fef714c864 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:23.467326 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ad380c33-1af3-4d06-8e53-b0fef714c864 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:23.468042 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ad380c33-1af3-4d06-8e53-b0fef714c864 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:23.495199 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:23.651743 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ad380c33-1af3-4d06-8e53-b0fef714c864 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:23.668542 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-ad380c33-1af3-4d06-8e53-b0fef714c864 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1302 microversion: 2.1 time: 0.216016 Jul 25 23:06:23.668542 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 160/322] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:23 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1302 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:06:23.685941 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-ecf488a4-60c5-46c3-a9d8-704d4158c0b1 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:23.695339 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-ecf488a4-60c5-46c3-a9d8-704d4158c0b1 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:23.699658 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell0:SELECT=4 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:23.716782 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ecf488a4-60c5-46c3-a9d8-704d4158c0b1 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:23.717552 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ecf488a4-60c5-46c3-a9d8-704d4158c0b1 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:23.718549 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ecf488a4-60c5-46c3-a9d8-704d4158c0b1 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:23.719186 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ecf488a4-60c5-46c3-a9d8-704d4158c0b1 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:23.772143 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-bd172310-aa05-423a-8db8-2be0de76f9ea tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:23.781951 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-bd172310-aa05-423a-8db8-2be0de76f9ea tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:23.786024 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-bd172310-aa05-423a-8db8-2be0de76f9ea tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:23.787804 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-bd172310-aa05-423a-8db8-2be0de76f9ea tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1740 microversion: 2.20 time: 0.397865 Jul 25 23:06:23.801819 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 163/323] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:23 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1740 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:06:23.965350 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-39c2a009-b126-459c-818a-b5fd66bc1ad5 req-448f0943-6b89-4701-8bc8-343d9c56bcf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e78f6354-b88d-45a6-817b-4ef206d07d33", "name": "network-vif-plugged", "status": "completed", "tag": "b7e5b654-c700-4c79-966e-9953941ea57a"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:06:23.997806 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-39c2a009-b126-459c-818a-b5fd66bc1ad5 req-448f0943-6b89-4701-8bc8-343d9c56bcf3 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:23.998299 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ecf488a4-60c5-46c3-a9d8-704d4158c0b1 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:23.998934 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-39c2a009-b126-459c-818a-b5fd66bc1ad5 req-448f0943-6b89-4701-8bc8-343d9c56bcf3 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:24.014220 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-39c2a009-b126-459c-818a-b5fd66bc1ad5 req-448f0943-6b89-4701-8bc8-343d9c56bcf3 service nova] Creating event network-vif-plugged:b7e5b654-c700-4c79-966e-9953941ea57a for instance e78f6354-b88d-45a6-817b-4ef206d07d33 on hv-cinder-79760 Jul 25 23:06:24.014428 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-ecf488a4-60c5-46c3-a9d8-704d4158c0b1 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1724 microversion: 2.1 time: 0.332149 Jul 25 23:06:24.015262 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 161/324] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:23 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1724 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:24.020953 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-39c2a009-b126-459c-818a-b5fd66bc1ad5 req-448f0943-6b89-4701-8bc8-343d9c56bcf3 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061868 Jul 25 23:06:24.021583 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 164/325] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:06:24.685915 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-2db5c362-9e16-492d-919d-fa4124c4239f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:24.688004 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-2db5c362-9e16-492d-919d-fa4124c4239f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:24.710705 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2db5c362-9e16-492d-919d-fa4124c4239f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:24.712669 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2db5c362-9e16-492d-919d-fa4124c4239f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:24.714442 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2db5c362-9e16-492d-919d-fa4124c4239f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:24.717263 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2db5c362-9e16-492d-919d-fa4124c4239f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:24.947048 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-3f2ca54f-be65-4abc-a395-8c6c289e56b1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:24.947048 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-3f2ca54f-be65-4abc-a395-8c6c289e56b1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:24.949246 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-2db5c362-9e16-492d-919d-fa4124c4239f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:24.949367 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3f2ca54f-be65-4abc-a395-8c6c289e56b1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:24.949367 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3f2ca54f-be65-4abc-a395-8c6c289e56b1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:24.949367 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3f2ca54f-be65-4abc-a395-8c6c289e56b1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:24.949367 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3f2ca54f-be65-4abc-a395-8c6c289e56b1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:24.949701 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-2db5c362-9e16-492d-919d-fa4124c4239f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1300 microversion: 2.1 time: 0.155671 Jul 25 23:06:24.949701 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 162/326] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:24 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1300 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:24.949701 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f696ea5d-6e51-47eb-aad5-ce6b108923f0 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1536731079", "imageRef": "8e9f3265-0fdf-483a-8e2e-41d408f5f0e7", "flavorRef": "452", "networks": [{"uuid": "400f5b04-571f-4657-816e-0dd50576e231"}]}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:06:24.989050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-3f2ca54f-be65-4abc-a395-8c6c289e56b1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:25.001238 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-3f2ca54f-be65-4abc-a395-8c6c289e56b1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:25.004015 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-3f2ca54f-be65-4abc-a395-8c6c289e56b1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:25.008293 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-3f2ca54f-be65-4abc-a395-8c6c289e56b1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1740 microversion: 2.20 time: 0.196766 Jul 25 23:06:25.012467 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 165/327] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:24 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:06:25.036861 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-15c38780-1717-44de-9133-2ddce58e477d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:25.037576 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-15c38780-1717-44de-9133-2ddce58e477d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:25.038735 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.network.neutron [None req-f696ea5d-6e51-47eb-aad5-ce6b108923f0 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] validate_networks() for [('400f5b04-571f-4657-816e-0dd50576e231', None, None, None, None, None)] {{(pid=118410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 23:06:25.044160 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-15c38780-1717-44de-9133-2ddce58e477d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:25.044609 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-15c38780-1717-44de-9133-2ddce58e477d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:25.045402 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-15c38780-1717-44de-9133-2ddce58e477d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:25.046013 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-15c38780-1717-44de-9133-2ddce58e477d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:25.464606 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-15c38780-1717-44de-9133-2ddce58e477d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:25.464606 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-15c38780-1717-44de-9133-2ddce58e477d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1724 microversion: 2.1 time: 0.292964 Jul 25 23:06:25.464606 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 166/328] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:25 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1724 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:06:25.593904 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-f696ea5d-6e51-47eb-aad5-ce6b108923f0 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Flavor limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 23:06:25.594321 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-f696ea5d-6e51-47eb-aad5-ce6b108923f0 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Image limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 23:06:25.594793 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-f696ea5d-6e51-47eb-aad5-ce6b108923f0 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Flavor pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 23:06:25.595197 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-f696ea5d-6e51-47eb-aad5-ce6b108923f0 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Image pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 23:06:25.595605 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-f696ea5d-6e51-47eb-aad5-ce6b108923f0 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 23:06:25.607984 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f696ea5d-6e51-47eb-aad5-ce6b108923f0 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:25.608777 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f696ea5d-6e51-47eb-aad5-ce6b108923f0 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:25.609850 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f696ea5d-6e51-47eb-aad5-ce6b108923f0 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:25.610588 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f696ea5d-6e51-47eb-aad5-ce6b108923f0 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:25.639903 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-f696ea5d-6e51-47eb-aad5-ce6b108923f0 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Getting quotas for project 78f2a5cc4b7d4699ad5b00d3f3a9830e. Resources: {'instances', 'cores', 'ram'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 23:06:25.643937 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-f696ea5d-6e51-47eb-aad5-ce6b108923f0 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Getting quotas for user ec45d64732fe4aac9fe6b9d6cd04a6f4 and project 78f2a5cc4b7d4699ad5b00d3f3a9830e. Resources: {'instances', 'cores', 'ram'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 23:06:25.660769 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f696ea5d-6e51-47eb-aad5-ce6b108923f0 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Going to run 1 instances... {{(pid=118410) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 23:06:25.663328 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f696ea5d-6e51-47eb-aad5-ce6b108923f0 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e9f3265-0fdf-483a-8e2e-41d408f5f0e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 23:06:25.944011 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-e7299b1d-9d78-44b5-851c-5d771739258c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:25.945007 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-e7299b1d-9d78-44b5-851c-5d771739258c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:25.952392 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e7299b1d-9d78-44b5-851c-5d771739258c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:25.953270 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e7299b1d-9d78-44b5-851c-5d771739258c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:25.956076 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e7299b1d-9d78-44b5-851c-5d771739258c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:25.956759 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e7299b1d-9d78-44b5-851c-5d771739258c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:26.101662 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f696ea5d-6e51-47eb-aad5-ce6b108923f0 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.165299 Jul 25 23:06:26.103656 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 163/329] 10.222.0.55 () {60 vars in 1147 bytes} [Mon Jul 25 23:06:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1168 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 23:06:26.132496 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4d127f2d-cbb2-4d19-bddf-0da72b97593f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:26.140764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4d127f2d-cbb2-4d19-bddf-0da72b97593f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:26.150431 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4d127f2d-cbb2-4d19-bddf-0da72b97593f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:26.151391 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4d127f2d-cbb2-4d19-bddf-0da72b97593f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:26.152465 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4d127f2d-cbb2-4d19-bddf-0da72b97593f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:26.166802 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4d127f2d-cbb2-4d19-bddf-0da72b97593f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:26.380608 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-e7299b1d-9d78-44b5-851c-5d771739258c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:26.391277 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-e7299b1d-9d78-44b5-851c-5d771739258c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1368 microversion: 2.1 time: 0.451289 Jul 25 23:06:26.412637 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 167/330] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:25 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1368 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:26.424404 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-e9e5cd02-537c-4c0d-88e9-ef94283bc72b tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:26.425403 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-e9e5cd02-537c-4c0d-88e9-ef94283bc72b tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:26.499650 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-e9e5cd02-537c-4c0d-88e9-ef94283bc72b tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:26.513553 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-e9e5cd02-537c-4c0d-88e9-ef94283bc72b tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5" status: 200 len: 1219 microversion: 2.1 time: 0.098099 Jul 25 23:06:26.514827 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 168/331] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:26 2022] GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:26.537445 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-d7c81e0f-e076-42b8-a8a6-76695ca41e16 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:26.542569 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-d7c81e0f-e076-42b8-a8a6-76695ca41e16 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:26.547849 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4d127f2d-cbb2-4d19-bddf-0da72b97593f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:26.556717 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d7c81e0f-e076-42b8-a8a6-76695ca41e16 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:26.557161 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4d127f2d-cbb2-4d19-bddf-0da72b97593f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:26.557542 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d7c81e0f-e076-42b8-a8a6-76695ca41e16 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:26.559922 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d7c81e0f-e076-42b8-a8a6-76695ca41e16 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:26.564138 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4d127f2d-cbb2-4d19-bddf-0da72b97593f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:26.565690 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4d127f2d-cbb2-4d19-bddf-0da72b97593f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1740 microversion: 2.20 time: 0.460473 Jul 25 23:06:26.566439 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d7c81e0f-e076-42b8-a8a6-76695ca41e16 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:26.568523 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 164/332] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:26 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1740 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:06:27.056254 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-d7c81e0f-e076-42b8-a8a6-76695ca41e16 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:27.056254 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-d7c81e0f-e076-42b8-a8a6-76695ca41e16 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1724 microversion: 2.1 time: 0.525954 Jul 25 23:06:27.056254 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 169/333] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:26 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1724 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:27.414741 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-355820e9-f402-4b12-bdfb-04bab31a54bc tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:27.415599 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-355820e9-f402-4b12-bdfb-04bab31a54bc tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:27.417925 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:27.422791 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-355820e9-f402-4b12-bdfb-04bab31a54bc tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:27.423245 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-355820e9-f402-4b12-bdfb-04bab31a54bc tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:27.424005 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-355820e9-f402-4b12-bdfb-04bab31a54bc tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:27.424440 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-355820e9-f402-4b12-bdfb-04bab31a54bc tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:27.536089 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-9eaddad2-69a9-46f7-910c-d3a0ce5bc291 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:27.536792 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-9eaddad2-69a9-46f7-910c-d3a0ce5bc291 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:27.557753 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-355820e9-f402-4b12-bdfb-04bab31a54bc tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:27.567153 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-355820e9-f402-4b12-bdfb-04bab31a54bc tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1368 microversion: 2.1 time: 0.156541 Jul 25 23:06:27.579631 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 165/334] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:27 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:27.589944 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-05809fd0-8901-40a8-a469-8cbe163bf1a2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:27.590679 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-05809fd0-8901-40a8-a469-8cbe163bf1a2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:27.593558 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-9eaddad2-69a9-46f7-910c-d3a0ce5bc291 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:27.596596 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-05809fd0-8901-40a8-a469-8cbe163bf1a2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:27.597513 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-05809fd0-8901-40a8-a469-8cbe163bf1a2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:27.600199 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-05809fd0-8901-40a8-a469-8cbe163bf1a2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:27.600199 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-05809fd0-8901-40a8-a469-8cbe163bf1a2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:27.601456 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-9eaddad2-69a9-46f7-910c-d3a0ce5bc291 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5" status: 200 len: 1219 microversion: 2.1 time: 0.069125 Jul 25 23:06:27.602707 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 170/335] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:27 2022] GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5 => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:06:28.058099 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-05809fd0-8901-40a8-a469-8cbe163bf1a2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:28.066584 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-05809fd0-8901-40a8-a469-8cbe163bf1a2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:28.075741 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-05809fd0-8901-40a8-a469-8cbe163bf1a2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:28.077510 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-05809fd0-8901-40a8-a469-8cbe163bf1a2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1740 microversion: 2.20 time: 0.491492 Jul 25 23:06:28.093506 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 166/336] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:27 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1740 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:06:28.126190 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-787d1626-596b-439e-a5d5-bfd09e9787a5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:28.126862 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-787d1626-596b-439e-a5d5-bfd09e9787a5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:28.136013 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-787d1626-596b-439e-a5d5-bfd09e9787a5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:28.136457 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-787d1626-596b-439e-a5d5-bfd09e9787a5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:28.142548 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-787d1626-596b-439e-a5d5-bfd09e9787a5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:28.143407 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-787d1626-596b-439e-a5d5-bfd09e9787a5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:28.306379 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-787d1626-596b-439e-a5d5-bfd09e9787a5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:28.319564 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-787d1626-596b-439e-a5d5-bfd09e9787a5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1724 microversion: 2.1 time: 0.205274 Jul 25 23:06:28.320385 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 171/337] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:28 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:28.380850 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-a905eeef-793b-42bf-9364-70b8d0c3e29d req-4d3829b1-aee3-4f77-8cbc-5330a34117da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b265736-7f3b-4414-a694-38120987bad8", "tag": "e1b7bf8a-034c-4009-9dae-e893018ee8ee"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:06:28.399081 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-a905eeef-793b-42bf-9364-70b8d0c3e29d req-4d3829b1-aee3-4f77-8cbc-5330a34117da service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:28.399529 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-a905eeef-793b-42bf-9364-70b8d0c3e29d req-4d3829b1-aee3-4f77-8cbc-5330a34117da service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:28.426774 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-a905eeef-793b-42bf-9364-70b8d0c3e29d req-4d3829b1-aee3-4f77-8cbc-5330a34117da service nova] Creating event network-changed:e1b7bf8a-034c-4009-9dae-e893018ee8ee for instance 6b265736-7f3b-4414-a694-38120987bad8 on hv-cinder-79760 Jul 25 23:06:28.433375 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-a905eeef-793b-42bf-9364-70b8d0c3e29d req-4d3829b1-aee3-4f77-8cbc-5330a34117da service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056637 Jul 25 23:06:28.434866 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 167/338] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:06:28.716520 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-e3fc3cd4-043d-4d29-a744-0fb8cc861a14 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:28.716520 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-e3fc3cd4-043d-4d29-a744-0fb8cc861a14 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:28.716520 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e3fc3cd4-043d-4d29-a744-0fb8cc861a14 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:28.716520 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e3fc3cd4-043d-4d29-a744-0fb8cc861a14 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:28.718524 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e3fc3cd4-043d-4d29-a744-0fb8cc861a14 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:28.718524 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e3fc3cd4-043d-4d29-a744-0fb8cc861a14 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:28.718708 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-3b0c1acd-b6f8-4bde-9c65-9ef137f79cda tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:28.718708 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-3b0c1acd-b6f8-4bde-9c65-9ef137f79cda tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:28.718898 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:28.718989 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3b0c1acd-b6f8-4bde-9c65-9ef137f79cda tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:28.718989 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3b0c1acd-b6f8-4bde-9c65-9ef137f79cda tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:28.718989 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3b0c1acd-b6f8-4bde-9c65-9ef137f79cda tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:28.718989 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3b0c1acd-b6f8-4bde-9c65-9ef137f79cda tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:28.737082 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-3b0c1acd-b6f8-4bde-9c65-9ef137f79cda tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:28.769285 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-3b0c1acd-b6f8-4bde-9c65-9ef137f79cda tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5" status: 200 len: 1223 microversion: 2.1 time: 0.146731 Jul 25 23:06:28.770711 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 168/339] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:28 2022] GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5 => generated 1223 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:06:28.821322 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-e3fc3cd4-043d-4d29-a744-0fb8cc861a14 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:28.827006 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-e3fc3cd4-043d-4d29-a744-0fb8cc861a14 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1368 microversion: 2.1 time: 0.242514 Jul 25 23:06:28.827800 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 172/340] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:28 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1368 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:29.104280 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d7cc69a1-0dcd-43c4-bfc0-a4cfddd9db92 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:29.105174 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-d7cc69a1-0dcd-43c4-bfc0-a4cfddd9db92 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:29.117632 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d7cc69a1-0dcd-43c4-bfc0-a4cfddd9db92 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:29.124709 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d7cc69a1-0dcd-43c4-bfc0-a4cfddd9db92 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:29.131515 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d7cc69a1-0dcd-43c4-bfc0-a4cfddd9db92 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:29.134280 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d7cc69a1-0dcd-43c4-bfc0-a4cfddd9db92 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:29.347708 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-b2320316-5185-4568-b361-b9f7323bc83e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:29.348791 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-b2320316-5185-4568-b361-b9f7323bc83e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:29.356694 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b2320316-5185-4568-b361-b9f7323bc83e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:29.357533 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b2320316-5185-4568-b361-b9f7323bc83e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:29.359113 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b2320316-5185-4568-b361-b9f7323bc83e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:29.359836 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b2320316-5185-4568-b361-b9f7323bc83e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:29.666691 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-d7cc69a1-0dcd-43c4-bfc0-a4cfddd9db92 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:29.679661 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-d7cc69a1-0dcd-43c4-bfc0-a4cfddd9db92 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:29.682365 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-d7cc69a1-0dcd-43c4-bfc0-a4cfddd9db92 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:29.683850 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-d7cc69a1-0dcd-43c4-bfc0-a4cfddd9db92 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1740 microversion: 2.20 time: 0.585742 Jul 25 23:06:29.684652 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 169/341] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:29 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1740 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:06:29.722721 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-b2320316-5185-4568-b361-b9f7323bc83e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:29.734510 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-b2320316-5185-4568-b361-b9f7323bc83e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1724 microversion: 2.1 time: 0.390505 Jul 25 23:06:29.745335 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 173/342] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:29 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1724 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:29.795504 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-2092e164-75ac-4abb-9c26-6053c3bbb974 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:29.796101 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-2092e164-75ac-4abb-9c26-6053c3bbb974 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:29.802463 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2092e164-75ac-4abb-9c26-6053c3bbb974 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:29.802914 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2092e164-75ac-4abb-9c26-6053c3bbb974 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:29.803686 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2092e164-75ac-4abb-9c26-6053c3bbb974 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:29.804119 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2092e164-75ac-4abb-9c26-6053c3bbb974 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:29.847913 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-d04d6745-03d6-453f-b3b8-a6066a38dde6 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:29.849274 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-d04d6745-03d6-453f-b3b8-a6066a38dde6 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:29.858960 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d04d6745-03d6-453f-b3b8-a6066a38dde6 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:29.863069 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d04d6745-03d6-453f-b3b8-a6066a38dde6 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:29.864299 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d04d6745-03d6-453f-b3b8-a6066a38dde6 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:29.864959 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d04d6745-03d6-453f-b3b8-a6066a38dde6 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:29.878245 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-2092e164-75ac-4abb-9c26-6053c3bbb974 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:29.886218 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-2092e164-75ac-4abb-9c26-6053c3bbb974 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5" status: 200 len: 1215 microversion: 2.1 time: 0.094436 Jul 25 23:06:29.886798 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 170/343] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:29 2022] GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5 => generated 1215 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:30.026132 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-d04d6745-03d6-453f-b3b8-a6066a38dde6 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:30.038940 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-d04d6745-03d6-453f-b3b8-a6066a38dde6 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1368 microversion: 2.1 time: 0.194805 Jul 25 23:06:30.040484 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 174/344] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:29 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1368 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:30.708073 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5b42b700-ee2c-4dbb-b35a-c7e479957af8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:30.709176 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-5b42b700-ee2c-4dbb-b35a-c7e479957af8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:30.716588 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5b42b700-ee2c-4dbb-b35a-c7e479957af8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:30.717446 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5b42b700-ee2c-4dbb-b35a-c7e479957af8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:30.718713 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5b42b700-ee2c-4dbb-b35a-c7e479957af8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:30.719369 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5b42b700-ee2c-4dbb-b35a-c7e479957af8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:30.757758 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-6e624487-c796-43ed-8e77-710ce5dbbf09 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:30.758343 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-6e624487-c796-43ed-8e77-710ce5dbbf09 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:30.780259 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6e624487-c796-43ed-8e77-710ce5dbbf09 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:30.780259 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6e624487-c796-43ed-8e77-710ce5dbbf09 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:30.780850 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6e624487-c796-43ed-8e77-710ce5dbbf09 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:30.781328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6e624487-c796-43ed-8e77-710ce5dbbf09 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:30.969561 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-5b42b700-ee2c-4dbb-b35a-c7e479957af8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:30.978162 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-5b42b700-ee2c-4dbb-b35a-c7e479957af8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:30.979930 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-5b42b700-ee2c-4dbb-b35a-c7e479957af8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:30.981083 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-5b42b700-ee2c-4dbb-b35a-c7e479957af8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1740 microversion: 2.20 time: 0.277354 Jul 25 23:06:30.981661 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 171/345] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:30 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1740 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:06:30.986031 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-672c593f-ee13-40a2-9651-58a8f0165840 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:30.986623 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-672c593f-ee13-40a2-9651-58a8f0165840 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:30.993585 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-672c593f-ee13-40a2-9651-58a8f0165840 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:30.994058 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-672c593f-ee13-40a2-9651-58a8f0165840 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:30.994476 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-6e624487-c796-43ed-8e77-710ce5dbbf09 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:30.994832 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-672c593f-ee13-40a2-9651-58a8f0165840 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:30.995268 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-672c593f-ee13-40a2-9651-58a8f0165840 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:31.005857 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-6e624487-c796-43ed-8e77-710ce5dbbf09 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1724 microversion: 2.1 time: 0.251770 Jul 25 23:06:31.006590 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 175/346] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:30 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1724 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:31.062461 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-8d1a1b70-66a5-4ce9-8a73-b2eda31b0d31 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:31.063364 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-8d1a1b70-66a5-4ce9-8a73-b2eda31b0d31 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:31.064842 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-672c593f-ee13-40a2-9651-58a8f0165840 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:31.070185 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8d1a1b70-66a5-4ce9-8a73-b2eda31b0d31 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:31.070632 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8d1a1b70-66a5-4ce9-8a73-b2eda31b0d31 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:31.071489 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8d1a1b70-66a5-4ce9-8a73-b2eda31b0d31 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:31.071925 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8d1a1b70-66a5-4ce9-8a73-b2eda31b0d31 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:31.073362 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-672c593f-ee13-40a2-9651-58a8f0165840 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5" status: 200 len: 1215 microversion: 2.1 time: 0.090531 Jul 25 23:06:31.074039 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 172/347] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:30 2022] GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5 => generated 1215 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:31.224990 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-8d1a1b70-66a5-4ce9-8a73-b2eda31b0d31 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:31.233527 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-8d1a1b70-66a5-4ce9-8a73-b2eda31b0d31 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1368 microversion: 2.1 time: 0.176710 Jul 25 23:06:31.234088 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 176/348] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:31 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:06:32.006116 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-de9e9239-3f7b-4e18-a141-c082e412b579 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:32.006731 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-de9e9239-3f7b-4e18-a141-c082e412b579 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:32.014026 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-de9e9239-3f7b-4e18-a141-c082e412b579 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:32.026069 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-de9e9239-3f7b-4e18-a141-c082e412b579 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:32.026069 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-de9e9239-3f7b-4e18-a141-c082e412b579 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:32.026069 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-de9e9239-3f7b-4e18-a141-c082e412b579 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:32.028584 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-ea119e1d-b5e0-4c24-9d87-d73126f67462 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:32.029263 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-ea119e1d-b5e0-4c24-9d87-d73126f67462 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:32.039382 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ea119e1d-b5e0-4c24-9d87-d73126f67462 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:32.039910 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ea119e1d-b5e0-4c24-9d87-d73126f67462 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:32.041939 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ea119e1d-b5e0-4c24-9d87-d73126f67462 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:32.048552 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ea119e1d-b5e0-4c24-9d87-d73126f67462 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:32.302640 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-de9e9239-3f7b-4e18-a141-c082e412b579 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:32.316419 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-ea119e1d-b5e0-4c24-9d87-d73126f67462 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:32.325992 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-ea119e1d-b5e0-4c24-9d87-d73126f67462 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1724 microversion: 2.1 time: 0.302337 Jul 25 23:06:32.326640 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 177/349] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:32 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1724 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:32.328306 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-de9e9239-3f7b-4e18-a141-c082e412b579 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:32.329976 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-de9e9239-3f7b-4e18-a141-c082e412b579 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:32.331163 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-53b453b2-6fc2-4d82-a56a-5171596f16df tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:32.331977 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-53b453b2-6fc2-4d82-a56a-5171596f16df tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:32.341004 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-de9e9239-3f7b-4e18-a141-c082e412b579 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1740 microversion: 2.20 time: 0.330236 Jul 25 23:06:32.345050 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 173/350] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:32 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1740 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:06:32.351313 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-ce3e56de-e24b-4dc2-b6a6-332ecfa4ef3e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:32.358524 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:32.359080 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-53b453b2-6fc2-4d82-a56a-5171596f16df tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:32.359682 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-53b453b2-6fc2-4d82-a56a-5171596f16df tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:32.360574 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-53b453b2-6fc2-4d82-a56a-5171596f16df tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:32.361078 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-53b453b2-6fc2-4d82-a56a-5171596f16df tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:32.363414 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-ce3e56de-e24b-4dc2-b6a6-332ecfa4ef3e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:32.381735 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ce3e56de-e24b-4dc2-b6a6-332ecfa4ef3e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:32.382540 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ce3e56de-e24b-4dc2-b6a6-332ecfa4ef3e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:32.384177 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ce3e56de-e24b-4dc2-b6a6-332ecfa4ef3e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:32.385215 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ce3e56de-e24b-4dc2-b6a6-332ecfa4ef3e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:32.492477 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-53b453b2-6fc2-4d82-a56a-5171596f16df tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:32.505498 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-53b453b2-6fc2-4d82-a56a-5171596f16df tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5" status: 200 len: 1271 microversion: 2.1 time: 0.177670 Jul 25 23:06:32.507165 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 178/351] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:32 2022] GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5 => generated 1271 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:32.624621 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ce3e56de-e24b-4dc2-b6a6-332ecfa4ef3e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:32.635854 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-ce3e56de-e24b-4dc2-b6a6-332ecfa4ef3e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1368 microversion: 2.1 time: 0.291193 Jul 25 23:06:32.636753 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 174/352] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:32 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1368 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:33.352791 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-306628f5-5a06-4314-ae49-7ca21097d2e4 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:33.353428 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-306628f5-5a06-4314-ae49-7ca21097d2e4 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:33.369249 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-54b2e9b1-a924-4078-95de-068d59d63d7d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:33.369830 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-306628f5-5a06-4314-ae49-7ca21097d2e4 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:33.369930 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-54b2e9b1-a924-4078-95de-068d59d63d7d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:33.370101 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-306628f5-5a06-4314-ae49-7ca21097d2e4 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:33.371177 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-306628f5-5a06-4314-ae49-7ca21097d2e4 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:33.372538 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-306628f5-5a06-4314-ae49-7ca21097d2e4 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:33.391456 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-54b2e9b1-a924-4078-95de-068d59d63d7d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:33.396624 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-54b2e9b1-a924-4078-95de-068d59d63d7d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:33.397728 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-54b2e9b1-a924-4078-95de-068d59d63d7d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:33.398308 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-54b2e9b1-a924-4078-95de-068d59d63d7d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:33.609586 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-306628f5-5a06-4314-ae49-7ca21097d2e4 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:33.619553 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-306628f5-5a06-4314-ae49-7ca21097d2e4 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1724 microversion: 2.1 time: 0.271402 Jul 25 23:06:33.620137 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 179/353] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:33 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1724 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:33.624587 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-c7a9ea2b-6d6a-4953-98d4-e0ba7580f9cf tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:33.635096 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-c7a9ea2b-6d6a-4953-98d4-e0ba7580f9cf tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:33.641455 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-54b2e9b1-a924-4078-95de-068d59d63d7d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:33.642393 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c7a9ea2b-6d6a-4953-98d4-e0ba7580f9cf tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:33.643156 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c7a9ea2b-6d6a-4953-98d4-e0ba7580f9cf tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:33.644199 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c7a9ea2b-6d6a-4953-98d4-e0ba7580f9cf tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:33.645039 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c7a9ea2b-6d6a-4953-98d4-e0ba7580f9cf tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:33.665556 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-54b2e9b1-a924-4078-95de-068d59d63d7d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:33.669240 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-54b2e9b1-a924-4078-95de-068d59d63d7d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:33.674510 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-54b2e9b1-a924-4078-95de-068d59d63d7d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1740 microversion: 2.20 time: 0.309273 Jul 25 23:06:33.680364 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 175/354] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:33 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1740 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:06:33.684710 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-92547a44-34d0-4456-8131-4f1ef0858c9e tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:33.685583 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-92547a44-34d0-4456-8131-4f1ef0858c9e tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:33.709408 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-92547a44-34d0-4456-8131-4f1ef0858c9e tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:33.710002 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-92547a44-34d0-4456-8131-4f1ef0858c9e tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:33.711057 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-92547a44-34d0-4456-8131-4f1ef0858c9e tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:33.712334 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-92547a44-34d0-4456-8131-4f1ef0858c9e tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:33.807463 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-92547a44-34d0-4456-8131-4f1ef0858c9e tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:33.817456 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-92547a44-34d0-4456-8131-4f1ef0858c9e tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5" status: 200 len: 1289 microversion: 2.1 time: 0.137724 Jul 25 23:06:33.830258 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 176/355] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:33 2022] GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5 => generated 1289 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:33.839233 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-10bb9ca9-8e23-4684-b7da-7f8c042b546c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:33.841061 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-10bb9ca9-8e23-4684-b7da-7f8c042b546c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:33.847784 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-10bb9ca9-8e23-4684-b7da-7f8c042b546c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:33.848141 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-10bb9ca9-8e23-4684-b7da-7f8c042b546c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:33.848900 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-10bb9ca9-8e23-4684-b7da-7f8c042b546c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:33.849371 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-10bb9ca9-8e23-4684-b7da-7f8c042b546c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:33.875037 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-c7a9ea2b-6d6a-4953-98d4-e0ba7580f9cf tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:33.885986 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-c7a9ea2b-6d6a-4953-98d4-e0ba7580f9cf tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1593 microversion: 2.1 time: 0.264782 Jul 25 23:06:33.905575 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 180/356] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:33 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1593 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:34.062720 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-10bb9ca9-8e23-4684-b7da-7f8c042b546c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:34.073785 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-10bb9ca9-8e23-4684-b7da-7f8c042b546c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1368 microversion: 2.1 time: 0.242478 Jul 25 23:06:34.074409 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 177/357] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:33 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1368 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:34.640613 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-b9d8ba7b-732e-4ed2-9177-810d4380f3e6 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:34.641333 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-b9d8ba7b-732e-4ed2-9177-810d4380f3e6 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:34.651574 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b9d8ba7b-732e-4ed2-9177-810d4380f3e6 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:34.654478 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b9d8ba7b-732e-4ed2-9177-810d4380f3e6 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:34.656168 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b9d8ba7b-732e-4ed2-9177-810d4380f3e6 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:34.656814 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b9d8ba7b-732e-4ed2-9177-810d4380f3e6 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:34.719750 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-05a4f3ac-2af3-4e00-86f9-53a08b6c88d6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:34.720677 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-05a4f3ac-2af3-4e00-86f9-53a08b6c88d6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:34.727766 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-05a4f3ac-2af3-4e00-86f9-53a08b6c88d6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:34.728133 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-05a4f3ac-2af3-4e00-86f9-53a08b6c88d6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:34.728932 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-05a4f3ac-2af3-4e00-86f9-53a08b6c88d6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:34.729392 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-05a4f3ac-2af3-4e00-86f9-53a08b6c88d6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:34.734134 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=100 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:35.064894 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-05a4f3ac-2af3-4e00-86f9-53a08b6c88d6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:35.080614 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-05a4f3ac-2af3-4e00-86f9-53a08b6c88d6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:35.082150 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-05a4f3ac-2af3-4e00-86f9-53a08b6c88d6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:35.083509 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-05a4f3ac-2af3-4e00-86f9-53a08b6c88d6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1740 microversion: 2.20 time: 0.386007 Jul 25 23:06:35.084470 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 178/358] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:34 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1740 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:06:35.095270 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-b9d8ba7b-732e-4ed2-9177-810d4380f3e6 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:35.097503 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d19d3707-084d-4439-a579-c286848ae6e0 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:35.104069 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-d19d3707-084d-4439-a579-c286848ae6e0 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:35.107259 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-b9d8ba7b-732e-4ed2-9177-810d4380f3e6 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1724 microversion: 2.1 time: 0.470309 Jul 25 23:06:35.112785 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d19d3707-084d-4439-a579-c286848ae6e0 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:35.113480 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d19d3707-084d-4439-a579-c286848ae6e0 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:35.114807 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d19d3707-084d-4439-a579-c286848ae6e0 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:35.115549 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d19d3707-084d-4439-a579-c286848ae6e0 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:35.122886 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 181/359] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:34 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1724 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:35.127305 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-a22512ab-a654-4bb7-afad-0f0d19557597 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:35.127996 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-a22512ab-a654-4bb7-afad-0f0d19557597 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:35.135264 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a22512ab-a654-4bb7-afad-0f0d19557597 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:35.135711 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a22512ab-a654-4bb7-afad-0f0d19557597 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:35.136479 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a22512ab-a654-4bb7-afad-0f0d19557597 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:35.136906 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a22512ab-a654-4bb7-afad-0f0d19557597 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:35.209049 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-d19d3707-084d-4439-a579-c286848ae6e0 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:35.219975 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-d19d3707-084d-4439-a579-c286848ae6e0 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5" status: 200 len: 1277 microversion: 2.1 time: 0.133957 Jul 25 23:06:35.220998 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 179/360] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:35 2022] GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5 => generated 1277 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:35.304031 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-a22512ab-a654-4bb7-afad-0f0d19557597 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:35.312515 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-a22512ab-a654-4bb7-afad-0f0d19557597 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1368 microversion: 2.1 time: 0.189413 Jul 25 23:06:35.313209 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 182/361] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:35 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1368 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:36.119794 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e1880622-e8dc-4cbd-ba19-fc725de4951c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:36.124596 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e1880622-e8dc-4cbd-ba19-fc725de4951c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:36.135063 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-e28b3214-476c-473b-877c-8766d794d2c8 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:36.136319 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-e28b3214-476c-473b-877c-8766d794d2c8 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:36.150937 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=6 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:36.152083 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=14 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:36.153854 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e28b3214-476c-473b-877c-8766d794d2c8 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:36.166195 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e28b3214-476c-473b-877c-8766d794d2c8 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:36.166195 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e28b3214-476c-473b-877c-8766d794d2c8 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:36.166195 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e28b3214-476c-473b-877c-8766d794d2c8 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:36.166463 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e1880622-e8dc-4cbd-ba19-fc725de4951c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:36.166463 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e1880622-e8dc-4cbd-ba19-fc725de4951c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:36.166463 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e1880622-e8dc-4cbd-ba19-fc725de4951c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:36.168671 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e1880622-e8dc-4cbd-ba19-fc725de4951c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:36.676958 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e1880622-e8dc-4cbd-ba19-fc725de4951c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:36.685705 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e1880622-e8dc-4cbd-ba19-fc725de4951c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:36.687203 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e1880622-e8dc-4cbd-ba19-fc725de4951c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:36.688629 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e1880622-e8dc-4cbd-ba19-fc725de4951c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1740 microversion: 2.20 time: 0.576121 Jul 25 23:06:36.689214 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 180/362] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:36 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1740 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:06:36.694069 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-560e1550-1e6a-48ac-b0db-be935f699cdd tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:36.694905 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-560e1550-1e6a-48ac-b0db-be935f699cdd tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:36.704203 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-560e1550-1e6a-48ac-b0db-be935f699cdd tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:36.705043 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-560e1550-1e6a-48ac-b0db-be935f699cdd tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:36.705993 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-560e1550-1e6a-48ac-b0db-be935f699cdd tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:36.706435 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-560e1550-1e6a-48ac-b0db-be935f699cdd tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:36.733282 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-e28b3214-476c-473b-877c-8766d794d2c8 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:36.733945 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-e28b3214-476c-473b-877c-8766d794d2c8 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1724 microversion: 2.1 time: 0.603922 Jul 25 23:06:36.745332 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 183/363] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:36 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1724 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:36.745332 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-fe312610-465c-49af-a8f6-f633413f7b58 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:36.745332 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-fe312610-465c-49af-a8f6-f633413f7b58 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:36.753538 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-fe312610-465c-49af-a8f6-f633413f7b58 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:36.753538 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-fe312610-465c-49af-a8f6-f633413f7b58 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:36.754006 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-fe312610-465c-49af-a8f6-f633413f7b58 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:36.754439 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-fe312610-465c-49af-a8f6-f633413f7b58 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:37.246077 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-560e1550-1e6a-48ac-b0db-be935f699cdd tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:37.271010 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-fe312610-465c-49af-a8f6-f633413f7b58 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:37.277843 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-560e1550-1e6a-48ac-b0db-be935f699cdd tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5" status: 200 len: 1319 microversion: 2.1 time: 0.573406 Jul 25 23:06:37.288072 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 181/364] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:36 2022] GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5 => generated 1319 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:37.292574 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-fe312610-465c-49af-a8f6-f633413f7b58 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1368 microversion: 2.1 time: 0.556724 Jul 25 23:06:37.293402 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 184/365] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:36 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1368 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:37.344537 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-8cb3dac4-dbf8-4389-b570-e21caabce004 req-1a1deeb3-9dd6-45b9-b850-17bea90fbb6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5", "tag": "200e143d-89ff-4640-9b7b-c58b893181a2"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:06:37.355280 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-8cb3dac4-dbf8-4389-b570-e21caabce004 req-1a1deeb3-9dd6-45b9-b850-17bea90fbb6b service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:37.355280 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-8cb3dac4-dbf8-4389-b570-e21caabce004 req-1a1deeb3-9dd6-45b9-b850-17bea90fbb6b service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:37.369133 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-8cb3dac4-dbf8-4389-b570-e21caabce004 req-1a1deeb3-9dd6-45b9-b850-17bea90fbb6b service nova] Creating event network-changed:200e143d-89ff-4640-9b7b-c58b893181a2 for instance fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5 on hv-cinder-79760 Jul 25 23:06:37.375947 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-8cb3dac4-dbf8-4389-b570-e21caabce004 req-1a1deeb3-9dd6-45b9-b850-17bea90fbb6b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034693 Jul 25 23:06:37.376781 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 182/366] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:06:37.719663 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-912d7eff-215a-429b-afe9-fbfd190f5033 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:37.719663 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-912d7eff-215a-429b-afe9-fbfd190f5033 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:37.723037 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell0:SELECT=4 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:37.729106 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-912d7eff-215a-429b-afe9-fbfd190f5033 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:37.730128 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-912d7eff-215a-429b-afe9-fbfd190f5033 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:37.733667 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-912d7eff-215a-429b-afe9-fbfd190f5033 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:37.734313 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-912d7eff-215a-429b-afe9-fbfd190f5033 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:37.759681 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6ae32448-554b-4245-ad93-5ee5965d23b9 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:37.760433 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6ae32448-554b-4245-ad93-5ee5965d23b9 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:37.777093 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6ae32448-554b-4245-ad93-5ee5965d23b9 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:37.779083 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6ae32448-554b-4245-ad93-5ee5965d23b9 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:37.784523 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6ae32448-554b-4245-ad93-5ee5965d23b9 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:37.784979 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6ae32448-554b-4245-ad93-5ee5965d23b9 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:38.328964 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-912d7eff-215a-429b-afe9-fbfd190f5033 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:38.338279 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-912d7eff-215a-429b-afe9-fbfd190f5033 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:38.338714 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6ae32448-554b-4245-ad93-5ee5965d23b9 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:38.339980 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-912d7eff-215a-429b-afe9-fbfd190f5033 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:38.341179 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-912d7eff-215a-429b-afe9-fbfd190f5033 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1740 microversion: 2.20 time: 0.633110 Jul 25 23:06:38.341928 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 185/367] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:37 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1740 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:06:38.346913 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-d0f06cce-9bbe-41ee-8d3a-f47c873258bf tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:38.347509 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-d0f06cce-9bbe-41ee-8d3a-f47c873258bf tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:38.358661 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d0f06cce-9bbe-41ee-8d3a-f47c873258bf tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:38.359362 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d0f06cce-9bbe-41ee-8d3a-f47c873258bf tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:38.360537 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d0f06cce-9bbe-41ee-8d3a-f47c873258bf tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:38.361509 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d0f06cce-9bbe-41ee-8d3a-f47c873258bf tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:38.365495 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6ae32448-554b-4245-ad93-5ee5965d23b9 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1724 microversion: 2.1 time: 0.610498 Jul 25 23:06:38.380684 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 183/368] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:37 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1724 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:38.391000 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-92425a1c-7de7-49ea-af3d-a9052a574506 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:38.391804 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-92425a1c-7de7-49ea-af3d-a9052a574506 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:38.406711 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-92425a1c-7de7-49ea-af3d-a9052a574506 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:38.407747 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-92425a1c-7de7-49ea-af3d-a9052a574506 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:38.408604 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-92425a1c-7de7-49ea-af3d-a9052a574506 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:38.409034 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-92425a1c-7de7-49ea-af3d-a9052a574506 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:38.782359 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-d0f06cce-9bbe-41ee-8d3a-f47c873258bf tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:38.795811 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-d0f06cce-9bbe-41ee-8d3a-f47c873258bf tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5" status: 200 len: 1319 microversion: 2.1 time: 0.452048 Jul 25 23:06:38.796556 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 186/369] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:38 2022] GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5 => generated 1319 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:38.880748 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-92425a1c-7de7-49ea-af3d-a9052a574506 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:38.894912 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-92425a1c-7de7-49ea-af3d-a9052a574506 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1368 microversion: 2.1 time: 0.512373 Jul 25 23:06:38.895607 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 184/370] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:38 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1368 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:39.088681 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-15757832-5966-4eff-9e65-0527d4771ba8 req-e90bfe2c-e114-4764-9fa6-31015001e56f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "231ce093-ad72-4ed1-b3aa-f4f87da18ed8", "tag": "65c4e82d-ddb3-40b6-9509-99191d55da54"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:06:39.104389 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-15757832-5966-4eff-9e65-0527d4771ba8 req-e90bfe2c-e114-4764-9fa6-31015001e56f service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:39.104983 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-15757832-5966-4eff-9e65-0527d4771ba8 req-e90bfe2c-e114-4764-9fa6-31015001e56f service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:39.119037 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-15757832-5966-4eff-9e65-0527d4771ba8 req-e90bfe2c-e114-4764-9fa6-31015001e56f service nova] Creating event network-changed:65c4e82d-ddb3-40b6-9509-99191d55da54 for instance 231ce093-ad72-4ed1-b3aa-f4f87da18ed8 on hv-cinder-79760 Jul 25 23:06:39.125181 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-15757832-5966-4eff-9e65-0527d4771ba8 req-e90bfe2c-e114-4764-9fa6-31015001e56f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041614 Jul 25 23:06:39.126249 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 187/371] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:06:39.371891 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-9bba27e5-edfc-4829-88e9-2a4ef862edf6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:39.372340 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-9bba27e5-edfc-4829-88e9-2a4ef862edf6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:39.379301 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9bba27e5-edfc-4829-88e9-2a4ef862edf6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:39.379745 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9bba27e5-edfc-4829-88e9-2a4ef862edf6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:39.380523 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9bba27e5-edfc-4829-88e9-2a4ef862edf6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:39.381076 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9bba27e5-edfc-4829-88e9-2a4ef862edf6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:39.394938 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-d40172c9-ddd4-4da4-9d71-10121ddcbefd tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:39.398259 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-d40172c9-ddd4-4da4-9d71-10121ddcbefd tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:39.412436 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d40172c9-ddd4-4da4-9d71-10121ddcbefd tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:39.413001 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d40172c9-ddd4-4da4-9d71-10121ddcbefd tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:39.415503 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d40172c9-ddd4-4da4-9d71-10121ddcbefd tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:39.416404 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d40172c9-ddd4-4da4-9d71-10121ddcbefd tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:39.630062 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9bba27e5-edfc-4829-88e9-2a4ef862edf6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:39.634784 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-d40172c9-ddd4-4da4-9d71-10121ddcbefd tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:39.647569 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-d40172c9-ddd4-4da4-9d71-10121ddcbefd tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1724 microversion: 2.1 time: 0.256905 Jul 25 23:06:39.651744 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 188/372] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:39 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:06:39.668681 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9bba27e5-edfc-4829-88e9-2a4ef862edf6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:39.670370 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9bba27e5-edfc-4829-88e9-2a4ef862edf6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:39.671729 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-9bba27e5-edfc-4829-88e9-2a4ef862edf6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1722 microversion: 2.20 time: 0.304123 Jul 25 23:06:39.673777 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 185/373] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:39 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1722 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:06:39.818305 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-e149e068-c7cd-465f-ac49-b19123c41435 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:39.819064 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-e149e068-c7cd-465f-ac49-b19123c41435 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:39.826190 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e149e068-c7cd-465f-ac49-b19123c41435 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:39.826744 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e149e068-c7cd-465f-ac49-b19123c41435 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:39.827612 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e149e068-c7cd-465f-ac49-b19123c41435 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:39.828134 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e149e068-c7cd-465f-ac49-b19123c41435 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:39.917207 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d919ac6e-4601-48b5-a85c-d4eb382b37f3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:39.922525 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-d919ac6e-4601-48b5-a85c-d4eb382b37f3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:39.924361 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d919ac6e-4601-48b5-a85c-d4eb382b37f3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:39.924884 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d919ac6e-4601-48b5-a85c-d4eb382b37f3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:39.925770 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d919ac6e-4601-48b5-a85c-d4eb382b37f3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:39.926265 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d919ac6e-4601-48b5-a85c-d4eb382b37f3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:40.053626 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-e149e068-c7cd-465f-ac49-b19123c41435 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:40.058959 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=100 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:40.078147 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-e149e068-c7cd-465f-ac49-b19123c41435 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5" status: 200 len: 1319 microversion: 2.1 time: 0.263715 Jul 25 23:06:40.078756 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 189/374] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:39 2022] GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5 => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:40.134845 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-d919ac6e-4601-48b5-a85c-d4eb382b37f3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:40.143461 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-d919ac6e-4601-48b5-a85c-d4eb382b37f3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1368 microversion: 2.1 time: 0.231382 Jul 25 23:06:40.144036 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 186/375] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:39 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1368 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:40.235708 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-396bab8b-5410-4840-a230-3e1027717284 req-e306302f-c28c-4b20-a93a-357a3307e6a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b265736-7f3b-4414-a694-38120987bad8", "name": "network-vif-plugged", "status": "completed", "tag": "e1b7bf8a-034c-4009-9dae-e893018ee8ee"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:06:40.247853 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-396bab8b-5410-4840-a230-3e1027717284 req-e306302f-c28c-4b20-a93a-357a3307e6a6 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:40.248299 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-396bab8b-5410-4840-a230-3e1027717284 req-e306302f-c28c-4b20-a93a-357a3307e6a6 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:40.260551 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-396bab8b-5410-4840-a230-3e1027717284 req-e306302f-c28c-4b20-a93a-357a3307e6a6 service nova] Creating event network-vif-plugged:e1b7bf8a-034c-4009-9dae-e893018ee8ee for instance 6b265736-7f3b-4414-a694-38120987bad8 on hv-cinder-79760 Jul 25 23:06:40.265674 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-396bab8b-5410-4840-a230-3e1027717284 req-e306302f-c28c-4b20-a93a-357a3307e6a6 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036398 Jul 25 23:06:40.266280 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 190/376] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:06:40.676331 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-dc645da0-83ce-439d-b177-966e226b7247 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:40.677098 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-dc645da0-83ce-439d-b177-966e226b7247 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:40.686417 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dc645da0-83ce-439d-b177-966e226b7247 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:40.689659 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dc645da0-83ce-439d-b177-966e226b7247 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:40.691072 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dc645da0-83ce-439d-b177-966e226b7247 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:40.693400 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dc645da0-83ce-439d-b177-966e226b7247 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:40.704702 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-028a04f8-45bf-4ce2-b5c0-e48bbf409cc3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:40.706132 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-028a04f8-45bf-4ce2-b5c0-e48bbf409cc3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:40.716906 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-028a04f8-45bf-4ce2-b5c0-e48bbf409cc3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:40.717707 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-028a04f8-45bf-4ce2-b5c0-e48bbf409cc3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:40.718820 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-028a04f8-45bf-4ce2-b5c0-e48bbf409cc3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:40.720294 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-028a04f8-45bf-4ce2-b5c0-e48bbf409cc3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:41.233712 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-dc645da0-83ce-439d-b177-966e226b7247 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:41.235316 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-028a04f8-45bf-4ce2-b5c0-e48bbf409cc3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:41.248899 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-dc645da0-83ce-439d-b177-966e226b7247 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1701 microversion: 2.1 time: 0.580248 Jul 25 23:06:41.249523 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 187/377] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:40 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1701 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:41.259734 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-028a04f8-45bf-4ce2-b5c0-e48bbf409cc3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:41.261854 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-028a04f8-45bf-4ce2-b5c0-e48bbf409cc3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:41.263404 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-028a04f8-45bf-4ce2-b5c0-e48bbf409cc3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1722 microversion: 2.20 time: 0.563610 Jul 25 23:06:41.273896 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 191/378] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:40 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1722 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:06:41.278292 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f6a852e2-aa5d-4461-8b8b-4a8cd5a384ba tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:41.278889 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f6a852e2-aa5d-4461-8b8b-4a8cd5a384ba tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:41.285274 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f6a852e2-aa5d-4461-8b8b-4a8cd5a384ba tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:41.285940 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f6a852e2-aa5d-4461-8b8b-4a8cd5a384ba tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:41.286722 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f6a852e2-aa5d-4461-8b8b-4a8cd5a384ba tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:41.287668 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f6a852e2-aa5d-4461-8b8b-4a8cd5a384ba tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:41.288564 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-329374a4-5997-43f7-a04d-3db22deb16fc tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:41.289359 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-329374a4-5997-43f7-a04d-3db22deb16fc tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:41.296066 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-329374a4-5997-43f7-a04d-3db22deb16fc tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:41.296645 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-329374a4-5997-43f7-a04d-3db22deb16fc tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:41.297722 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-329374a4-5997-43f7-a04d-3db22deb16fc tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:41.298438 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-329374a4-5997-43f7-a04d-3db22deb16fc tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:41.519912 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f6a852e2-aa5d-4461-8b8b-4a8cd5a384ba tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:41.520159 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-329374a4-5997-43f7-a04d-3db22deb16fc tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:41.521418 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f6a852e2-aa5d-4461-8b8b-4a8cd5a384ba tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5" status: 200 len: 1319 microversion: 2.1 time: 0.251640 Jul 25 23:06:41.522509 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 188/379] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:41 2022] GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5 => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:41.527975 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5d4d7c61-e7a6-40af-9935-f02e82d76bf7 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:06:41.537942 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5d4d7c61-e7a6-40af-9935-f02e82d76bf7 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:41.539107 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-329374a4-5997-43f7-a04d-3db22deb16fc tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1368 microversion: 2.1 time: 0.263795 Jul 25 23:06:41.539812 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 192/380] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:41 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1368 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:41.542135 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5d4d7c61-e7a6-40af-9935-f02e82d76bf7 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:41.571560 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-5d4d7c61-e7a6-40af-9935-f02e82d76bf7 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Going to try to start instance {{(pid=118410) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 23:06:41.858140 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-5d4d7c61-e7a6-40af-9935-f02e82d76bf7 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "POST /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d/action" status: 202 len: 0 microversion: 2.1 time: 0.333224 Jul 25 23:06:41.861743 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 189/381] 10.222.0.55 () {60 vars in 1278 bytes} [Mon Jul 25 23:06:41 2022] POST /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 23:06:41.869905 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-8c63b628-1cc5-46cf-ba03-038361d161c2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:41.870544 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-8c63b628-1cc5-46cf-ba03-038361d161c2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:41.886279 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8c63b628-1cc5-46cf-ba03-038361d161c2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:41.886742 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8c63b628-1cc5-46cf-ba03-038361d161c2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:41.887459 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8c63b628-1cc5-46cf-ba03-038361d161c2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:41.888007 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8c63b628-1cc5-46cf-ba03-038361d161c2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:42.062073 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-8c63b628-1cc5-46cf-ba03-038361d161c2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:42.070163 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-8c63b628-1cc5-46cf-ba03-038361d161c2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1710 microversion: 2.1 time: 0.204879 Jul 25 23:06:42.071377 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 193/382] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:41 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1710 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:42.288310 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-a43dc441-6ed9-4c89-a441-0ce6ac823ae9 req-a8ef6b74-24ae-401c-93ea-4c5a614ed39d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e78f6354-b88d-45a6-817b-4ef206d07d33", "name": "network-vif-unplugged", "status": "completed", "tag": "b7e5b654-c700-4c79-966e-9953941ea57a"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:06:42.300093 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-a43dc441-6ed9-4c89-a441-0ce6ac823ae9 req-a8ef6b74-24ae-401c-93ea-4c5a614ed39d service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:42.300737 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-a43dc441-6ed9-4c89-a441-0ce6ac823ae9 req-a8ef6b74-24ae-401c-93ea-4c5a614ed39d service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:42.301624 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-83b6486f-1b33-459a-b028-c218f35b654f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:42.302351 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-83b6486f-1b33-459a-b028-c218f35b654f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:42.310512 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-83b6486f-1b33-459a-b028-c218f35b654f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:42.311110 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-83b6486f-1b33-459a-b028-c218f35b654f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:42.311997 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-83b6486f-1b33-459a-b028-c218f35b654f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:42.312530 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-83b6486f-1b33-459a-b028-c218f35b654f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:42.331088 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-a43dc441-6ed9-4c89-a441-0ce6ac823ae9 req-a8ef6b74-24ae-401c-93ea-4c5a614ed39d service nova] Creating event network-vif-unplugged:b7e5b654-c700-4c79-966e-9953941ea57a for instance e78f6354-b88d-45a6-817b-4ef206d07d33 on hv-cinder-79760 Jul 25 23:06:42.337388 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-a43dc441-6ed9-4c89-a441-0ce6ac823ae9 req-a8ef6b74-24ae-401c-93ea-4c5a614ed39d service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057731 Jul 25 23:06:42.338602 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 190/383] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:06:42.482757 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-83b6486f-1b33-459a-b028-c218f35b654f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:42.491757 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-83b6486f-1b33-459a-b028-c218f35b654f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:42.494128 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-83b6486f-1b33-459a-b028-c218f35b654f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:42.495459 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-83b6486f-1b33-459a-b028-c218f35b654f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1722 microversion: 2.20 time: 0.198388 Jul 25 23:06:42.496112 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 194/384] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:42 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:06:42.547284 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-939431fd-6cf9-4612-b55b-14cb189d8f08 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:42.547979 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-939431fd-6cf9-4612-b55b-14cb189d8f08 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:42.555328 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-939431fd-6cf9-4612-b55b-14cb189d8f08 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:42.562435 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-939431fd-6cf9-4612-b55b-14cb189d8f08 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:42.562435 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-939431fd-6cf9-4612-b55b-14cb189d8f08 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:42.562435 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-939431fd-6cf9-4612-b55b-14cb189d8f08 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:42.566152 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-db989118-6961-4181-9a8c-63da94dad6ba tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:42.568871 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-db989118-6961-4181-9a8c-63da94dad6ba tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:42.580685 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-db989118-6961-4181-9a8c-63da94dad6ba tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:42.582873 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-db989118-6961-4181-9a8c-63da94dad6ba tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:42.591926 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-db989118-6961-4181-9a8c-63da94dad6ba tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:42.596217 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-db989118-6961-4181-9a8c-63da94dad6ba tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:42.865595 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-939431fd-6cf9-4612-b55b-14cb189d8f08 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:42.876961 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-939431fd-6cf9-4612-b55b-14cb189d8f08 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5" status: 200 len: 1319 microversion: 2.1 time: 0.335407 Jul 25 23:06:42.877555 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 191/385] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:42 2022] GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5 => generated 1319 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:42.908809 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-65d60988-23a8-46cd-a65d-cb3aeab060cc tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1487652867"}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:06:42.909674 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-65d60988-23a8-46cd-a65d-cb3aeab060cc tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:42.910157 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-db989118-6961-4181-9a8c-63da94dad6ba tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:42.917422 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-65d60988-23a8-46cd-a65d-cb3aeab060cc tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:42.918069 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-65d60988-23a8-46cd-a65d-cb3aeab060cc tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:42.919200 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-65d60988-23a8-46cd-a65d-cb3aeab060cc tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:42.919795 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-65d60988-23a8-46cd-a65d-cb3aeab060cc tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:42.920325 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-db989118-6961-4181-9a8c-63da94dad6ba tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1368 microversion: 2.1 time: 0.361107 Jul 25 23:06:42.921342 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 195/386] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:42 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1368 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:43.065079 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.network.security_group_api [None req-65d60988-23a8-46cd-a65d-cb3aeab060cc tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Adding security group 976cbece-de9d-4247-946f-7d78b3c0c6f5 to port 65c4e82d-ddb3-40b6-9509-99191d55da54 Jul 25 23:06:43.092842 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-33a12ab3-f0b1-4158-ba5e-f10ed012b26f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:43.093549 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-33a12ab3-f0b1-4158-ba5e-f10ed012b26f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:43.099691 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-33a12ab3-f0b1-4158-ba5e-f10ed012b26f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:43.100148 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-33a12ab3-f0b1-4158-ba5e-f10ed012b26f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:43.100912 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-33a12ab3-f0b1-4158-ba5e-f10ed012b26f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:43.101375 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-33a12ab3-f0b1-4158-ba5e-f10ed012b26f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:43.379431 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-33a12ab3-f0b1-4158-ba5e-f10ed012b26f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:43.382394 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-33a12ab3-f0b1-4158-ba5e-f10ed012b26f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1710 microversion: 2.1 time: 0.292579 Jul 25 23:06:43.384670 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 196/387] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:43 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1710 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:06:43.519774 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-56f53ee6-9012-4851-92e8-9aa0fe266b5c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:43.520435 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-56f53ee6-9012-4851-92e8-9aa0fe266b5c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:43.528430 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-56f53ee6-9012-4851-92e8-9aa0fe266b5c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:43.529162 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-56f53ee6-9012-4851-92e8-9aa0fe266b5c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:43.529934 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-56f53ee6-9012-4851-92e8-9aa0fe266b5c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:43.530372 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-56f53ee6-9012-4851-92e8-9aa0fe266b5c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:43.679063 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-56f53ee6-9012-4851-92e8-9aa0fe266b5c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:43.691743 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-56f53ee6-9012-4851-92e8-9aa0fe266b5c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:43.693277 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-56f53ee6-9012-4851-92e8-9aa0fe266b5c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:43.695104 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-56f53ee6-9012-4851-92e8-9aa0fe266b5c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1725 microversion: 2.20 time: 0.179446 Jul 25 23:06:43.696335 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 197/388] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:43 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:06:43.726481 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-65d60988-23a8-46cd-a65d-cb3aeab060cc tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "POST /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8/action" status: 202 len: 0 microversion: 2.1 time: 0.827743 Jul 25 23:06:43.727126 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 192/389] 10.222.0.55 () {60 vars in 1278 bytes} [Mon Jul 25 23:06:42 2022] POST /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8/action => generated 0 bytes in 829 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 23:06:43.728181 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-df9c4df3-679f-445c-88c5-411a5eb88bcc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d7a99b94-b7f9-4e98-9a3f-76cb66e0b1d7"}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:06:43.732364 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-df9c4df3-679f-445c-88c5-411a5eb88bcc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:43.739429 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-90e97a3d-41be-4b96-9f74-a4d995f019b3 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:43.739909 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-90e97a3d-41be-4b96-9f74-a4d995f019b3 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:43.748784 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-90e97a3d-41be-4b96-9f74-a4d995f019b3 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:43.754929 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-90e97a3d-41be-4b96-9f74-a4d995f019b3 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:43.756204 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-90e97a3d-41be-4b96-9f74-a4d995f019b3 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:43.756806 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-90e97a3d-41be-4b96-9f74-a4d995f019b3 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:43.765644 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-df9c4df3-679f-445c-88c5-411a5eb88bcc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:43.767374 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-df9c4df3-679f-445c-88c5-411a5eb88bcc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:43.769879 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-df9c4df3-679f-445c-88c5-411a5eb88bcc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:43.774634 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-df9c4df3-679f-445c-88c5-411a5eb88bcc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:44.064067 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-90e97a3d-41be-4b96-9f74-a4d995f019b3 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:44.076320 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-90e97a3d-41be-4b96-9f74-a4d995f019b3 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1759 microversion: 2.1 time: 0.340923 Jul 25 23:06:44.076908 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 193/390] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:43 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1759 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:06:44.084445 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-dc8796df-3bb7-4ed8-8f88-dbc4606d9b5f req-0816c303-b10c-4913-ac41-265314c8e01f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "231ce093-ad72-4ed1-b3aa-f4f87da18ed8", "tag": "65c4e82d-ddb3-40b6-9509-99191d55da54"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:06:44.105415 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-dc8796df-3bb7-4ed8-8f88-dbc4606d9b5f req-0816c303-b10c-4913-ac41-265314c8e01f service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:44.112155 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-dc8796df-3bb7-4ed8-8f88-dbc4606d9b5f req-0816c303-b10c-4913-ac41-265314c8e01f service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:44.127454 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-dc8796df-3bb7-4ed8-8f88-dbc4606d9b5f req-0816c303-b10c-4913-ac41-265314c8e01f service nova] Creating event network-changed:65c4e82d-ddb3-40b6-9509-99191d55da54 for instance 231ce093-ad72-4ed1-b3aa-f4f87da18ed8 on hv-cinder-79760 Jul 25 23:06:44.133568 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-dc8796df-3bb7-4ed8-8f88-dbc4606d9b5f req-0816c303-b10c-4913-ac41-265314c8e01f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053481 Jul 25 23:06:44.134650 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 194/391] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:06:44.141593 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b55e8d1b-2ccc-4381-a967-e0cc75f5a94c tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:44.142595 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b55e8d1b-2ccc-4381-a967-e0cc75f5a94c tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:44.150939 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b55e8d1b-2ccc-4381-a967-e0cc75f5a94c tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:44.151654 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b55e8d1b-2ccc-4381-a967-e0cc75f5a94c tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:44.152634 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b55e8d1b-2ccc-4381-a967-e0cc75f5a94c tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:44.153069 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b55e8d1b-2ccc-4381-a967-e0cc75f5a94c tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:44.311031 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b55e8d1b-2ccc-4381-a967-e0cc75f5a94c tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:44.319512 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b55e8d1b-2ccc-4381-a967-e0cc75f5a94c tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5" status: 200 len: 1319 microversion: 2.1 time: 0.183377 Jul 25 23:06:44.320275 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 195/392] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:44 2022] GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:44.329848 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-bd2c6089-f1e4-4a18-82f5-794f10b7d037 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:44.330967 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-bd2c6089-f1e4-4a18-82f5-794f10b7d037 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:44.338868 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bd2c6089-f1e4-4a18-82f5-794f10b7d037 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:44.339468 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bd2c6089-f1e4-4a18-82f5-794f10b7d037 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:44.340364 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bd2c6089-f1e4-4a18-82f5-794f10b7d037 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:44.341043 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bd2c6089-f1e4-4a18-82f5-794f10b7d037 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:44.345815 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:44.533078 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-bd2c6089-f1e4-4a18-82f5-794f10b7d037 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:44.542171 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-bd2c6089-f1e4-4a18-82f5-794f10b7d037 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1368 microversion: 2.1 time: 0.220047 Jul 25 23:06:44.543194 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 196/393] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:44 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:44.548167 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-478747ae-4518-4404-848a-9595b553edae tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:44.548950 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-478747ae-4518-4404-848a-9595b553edae tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:44.555941 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-478747ae-4518-4404-848a-9595b553edae tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:44.556867 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-478747ae-4518-4404-848a-9595b553edae tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:44.557897 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-478747ae-4518-4404-848a-9595b553edae tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:44.558628 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-478747ae-4518-4404-848a-9595b553edae tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:44.732396 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-478747ae-4518-4404-848a-9595b553edae tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:44.740783 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-478747ae-4518-4404-848a-9595b553edae tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1710 microversion: 2.1 time: 0.196357 Jul 25 23:06:44.743273 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 197/394] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:44 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1710 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:44.748503 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-831507c4-6ab9-4f3d-9c6e-57235574d7ae req-985589b4-a703-43e4-9e1d-7bf08fa10c7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5", "name": "network-vif-plugged", "status": "completed", "tag": "200e143d-89ff-4640-9b7b-c58b893181a2"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:06:44.758664 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-831507c4-6ab9-4f3d-9c6e-57235574d7ae req-985589b4-a703-43e4-9e1d-7bf08fa10c7b service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:44.759574 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-831507c4-6ab9-4f3d-9c6e-57235574d7ae req-985589b4-a703-43e4-9e1d-7bf08fa10c7b service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:44.772934 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-831507c4-6ab9-4f3d-9c6e-57235574d7ae req-985589b4-a703-43e4-9e1d-7bf08fa10c7b service nova] Creating event network-vif-plugged:200e143d-89ff-4640-9b7b-c58b893181a2 for instance fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5 on hv-cinder-79760 Jul 25 23:06:44.780394 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-831507c4-6ab9-4f3d-9c6e-57235574d7ae req-985589b4-a703-43e4-9e1d-7bf08fa10c7b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035371 Jul 25 23:06:44.781054 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 198/395] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:06:45.110864 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-df9c4df3-679f-445c-88c5-411a5eb88bcc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "POST /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.389554 Jul 25 23:06:45.112839 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 198/396] 10.222.0.55 () {62 vars in 1364 bytes} [Mon Jul 25 23:06:43 2022] POST /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33/os-volume_attachments => generated 188 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 23:06:45.272114 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-be77cf54-9efd-4564-8298-4af85ba2ea4e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:06:45.272773 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-be77cf54-9efd-4564-8298-4af85ba2ea4e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:45.280544 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-be77cf54-9efd-4564-8298-4af85ba2ea4e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:45.281310 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-be77cf54-9efd-4564-8298-4af85ba2ea4e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:45.290923 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-be77cf54-9efd-4564-8298-4af85ba2ea4e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:45.290923 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-be77cf54-9efd-4564-8298-4af85ba2ea4e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:45.342849 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-8b38a599-d355-4f2c-91c2-d34ce1a1df18 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:45.343531 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-8b38a599-d355-4f2c-91c2-d34ce1a1df18 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:45.351454 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8b38a599-d355-4f2c-91c2-d34ce1a1df18 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:45.360502 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8b38a599-d355-4f2c-91c2-d34ce1a1df18 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:45.360502 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8b38a599-d355-4f2c-91c2-d34ce1a1df18 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:45.360502 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8b38a599-d355-4f2c-91c2-d34ce1a1df18 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:45.655060 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-8b38a599-d355-4f2c-91c2-d34ce1a1df18 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:45.667405 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-8b38a599-d355-4f2c-91c2-d34ce1a1df18 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5" status: 200 len: 1319 microversion: 2.1 time: 0.329015 Jul 25 23:06:45.677319 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 199/397] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:45 2022] GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5 => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:45.677319 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-d31adefc-4ed0-44fb-bc1c-3d843e208cd9 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:45.677319 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-d31adefc-4ed0-44fb-bc1c-3d843e208cd9 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:45.685535 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d31adefc-4ed0-44fb-bc1c-3d843e208cd9 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:45.686137 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d31adefc-4ed0-44fb-bc1c-3d843e208cd9 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:45.686955 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d31adefc-4ed0-44fb-bc1c-3d843e208cd9 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:45.687393 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d31adefc-4ed0-44fb-bc1c-3d843e208cd9 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:45.698086 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-be77cf54-9efd-4564-8298-4af85ba2ea4e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "POST /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33/action" status: 202 len: 0 microversion: 2.20 time: 0.433277 Jul 25 23:06:45.700036 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 199/398] 10.222.0.55 () {62 vars in 1319 bytes} [Mon Jul 25 23:06:45 2022] POST /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33/action => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 23:06:45.710488 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a9dfdc3d-9048-4892-b907-38b1bd115099 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:45.713271 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a9dfdc3d-9048-4892-b907-38b1bd115099 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:45.723325 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a9dfdc3d-9048-4892-b907-38b1bd115099 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:45.723974 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a9dfdc3d-9048-4892-b907-38b1bd115099 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:45.725111 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a9dfdc3d-9048-4892-b907-38b1bd115099 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:45.725813 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a9dfdc3d-9048-4892-b907-38b1bd115099 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:46.079405 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-d31adefc-4ed0-44fb-bc1c-3d843e208cd9 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:46.092535 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-d31adefc-4ed0-44fb-bc1c-3d843e208cd9 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1562 microversion: 2.1 time: 0.422864 Jul 25 23:06:46.092886 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a9dfdc3d-9048-4892-b907-38b1bd115099 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:46.094165 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 200/399] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:45 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1562 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:46.099498 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-6b32024b-faa5-4945-814c-761dfc3e7b1a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:46.100276 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-6b32024b-faa5-4945-814c-761dfc3e7b1a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:46.107383 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6b32024b-faa5-4945-814c-761dfc3e7b1a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:46.108708 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6b32024b-faa5-4945-814c-761dfc3e7b1a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:46.110180 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6b32024b-faa5-4945-814c-761dfc3e7b1a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:46.110788 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6b32024b-faa5-4945-814c-761dfc3e7b1a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:46.138282 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a9dfdc3d-9048-4892-b907-38b1bd115099 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:46.140246 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a9dfdc3d-9048-4892-b907-38b1bd115099 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:46.142667 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a9dfdc3d-9048-4892-b907-38b1bd115099 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1751 microversion: 2.20 time: 0.436204 Jul 25 23:06:46.144286 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 200/400] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:45 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1751 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:06:46.149722 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6f38fc72-c994-4ae1-a366-9340eba722a3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:46.150704 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6f38fc72-c994-4ae1-a366-9340eba722a3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:46.166028 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6f38fc72-c994-4ae1-a366-9340eba722a3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:46.166464 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6f38fc72-c994-4ae1-a366-9340eba722a3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:46.167239 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6f38fc72-c994-4ae1-a366-9340eba722a3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:46.169244 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6f38fc72-c994-4ae1-a366-9340eba722a3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:46.300093 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6f38fc72-c994-4ae1-a366-9340eba722a3 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.149941 Jul 25 23:06:46.300093 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 201/401] 10.222.0.55 () {58 vars in 1275 bytes} [Mon Jul 25 23:06:46 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8/os-interface => generated 284 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:06:46.348909 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-6b32024b-faa5-4945-814c-761dfc3e7b1a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:46.364142 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-6b32024b-faa5-4945-814c-761dfc3e7b1a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1710 microversion: 2.1 time: 0.268683 Jul 25 23:06:46.364869 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 201/402] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:46 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1710 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:46.689394 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a7f78b7c-6ffe-4a8a-b5c5-37c2ffece37f tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:46.690198 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a7f78b7c-6ffe-4a8a-b5c5-37c2ffece37f tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:46.698626 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a7f78b7c-6ffe-4a8a-b5c5-37c2ffece37f tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:46.702703 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a7f78b7c-6ffe-4a8a-b5c5-37c2ffece37f tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:46.702703 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a7f78b7c-6ffe-4a8a-b5c5-37c2ffece37f tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:46.702703 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a7f78b7c-6ffe-4a8a-b5c5-37c2ffece37f tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:46.896157 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a7f78b7c-6ffe-4a8a-b5c5-37c2ffece37f tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:46.904605 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a7f78b7c-6ffe-4a8a-b5c5-37c2ffece37f tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5" status: 200 len: 1319 microversion: 2.1 time: 0.218858 Jul 25 23:06:46.905506 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 202/403] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:46 2022] GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:47.171371 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-cee035f0-22be-49d6-9713-e6f512deb44b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:47.172202 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-cee035f0-22be-49d6-9713-e6f512deb44b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:47.179049 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cee035f0-22be-49d6-9713-e6f512deb44b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:47.180238 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cee035f0-22be-49d6-9713-e6f512deb44b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:47.181111 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cee035f0-22be-49d6-9713-e6f512deb44b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:47.181726 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cee035f0-22be-49d6-9713-e6f512deb44b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:47.369430 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-cee035f0-22be-49d6-9713-e6f512deb44b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:47.379338 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-cee035f0-22be-49d6-9713-e6f512deb44b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:47.380840 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-cee035f0-22be-49d6-9713-e6f512deb44b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:47.382009 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-cee035f0-22be-49d6-9713-e6f512deb44b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1751 microversion: 2.20 time: 0.217960 Jul 25 23:06:47.383399 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 202/404] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:47 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1751 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:06:47.396060 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-9805820d-2b89-43c0-9cc4-49e1fd62a425 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:47.396497 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-9805820d-2b89-43c0-9cc4-49e1fd62a425 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:47.406337 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9805820d-2b89-43c0-9cc4-49e1fd62a425 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:47.406814 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9805820d-2b89-43c0-9cc4-49e1fd62a425 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:47.407825 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9805820d-2b89-43c0-9cc4-49e1fd62a425 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:47.408424 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9805820d-2b89-43c0-9cc4-49e1fd62a425 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:47.533313 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-5003c4bf-6156-4816-91dc-199e117a948c req-1f5ad96b-5759-47f9-9ac6-e3c96363274b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b265736-7f3b-4414-a694-38120987bad8", "tag": "e1b7bf8a-034c-4009-9dae-e893018ee8ee"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:06:47.544630 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-5003c4bf-6156-4816-91dc-199e117a948c req-1f5ad96b-5759-47f9-9ac6-e3c96363274b service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:47.545068 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-5003c4bf-6156-4816-91dc-199e117a948c req-1f5ad96b-5759-47f9-9ac6-e3c96363274b service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:47.557433 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-5003c4bf-6156-4816-91dc-199e117a948c req-1f5ad96b-5759-47f9-9ac6-e3c96363274b service nova] Creating event network-changed:e1b7bf8a-034c-4009-9dae-e893018ee8ee for instance 6b265736-7f3b-4414-a694-38120987bad8 on hv-cinder-79760 Jul 25 23:06:47.567788 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9805820d-2b89-43c0-9cc4-49e1fd62a425 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:47.568553 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-5003c4bf-6156-4816-91dc-199e117a948c req-1f5ad96b-5759-47f9-9ac6-e3c96363274b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037708 Jul 25 23:06:47.568553 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 203/405] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 23:06:47.600954 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-9805820d-2b89-43c0-9cc4-49e1fd62a425 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1710 microversion: 2.1 time: 0.209121 Jul 25 23:06:47.601947 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 203/406] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:47 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1710 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:47.930758 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-c2a593df-8c3d-4219-b654-5826f3348771 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:47.931772 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-c2a593df-8c3d-4219-b654-5826f3348771 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:47.938169 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c2a593df-8c3d-4219-b654-5826f3348771 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:47.938619 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c2a593df-8c3d-4219-b654-5826f3348771 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:47.939389 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c2a593df-8c3d-4219-b654-5826f3348771 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:47.939825 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c2a593df-8c3d-4219-b654-5826f3348771 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:48.087123 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-c2a593df-8c3d-4219-b654-5826f3348771 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:48.095195 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-c2a593df-8c3d-4219-b654-5826f3348771 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5" status: 200 len: 1319 microversion: 2.1 time: 0.169198 Jul 25 23:06:48.096039 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 204/407] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:47 2022] GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:48.410949 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-77c64aa1-a812-48f5-80c5-0fb1069b557d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:48.412241 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-77c64aa1-a812-48f5-80c5-0fb1069b557d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:48.419325 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-77c64aa1-a812-48f5-80c5-0fb1069b557d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:48.419984 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-77c64aa1-a812-48f5-80c5-0fb1069b557d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:48.420814 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-77c64aa1-a812-48f5-80c5-0fb1069b557d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:48.421280 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-77c64aa1-a812-48f5-80c5-0fb1069b557d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:48.575834 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-77c64aa1-a812-48f5-80c5-0fb1069b557d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:48.584880 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-77c64aa1-a812-48f5-80c5-0fb1069b557d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:48.586445 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-77c64aa1-a812-48f5-80c5-0fb1069b557d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:48.587632 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-77c64aa1-a812-48f5-80c5-0fb1069b557d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1751 microversion: 2.20 time: 0.183065 Jul 25 23:06:48.588272 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 204/408] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:48 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1751 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:06:48.623889 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-b4ea39d7-5c66-4bce-b7e0-9ede25672d56 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:48.624649 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-b4ea39d7-5c66-4bce-b7e0-9ede25672d56 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:48.631564 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b4ea39d7-5c66-4bce-b7e0-9ede25672d56 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:48.632016 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b4ea39d7-5c66-4bce-b7e0-9ede25672d56 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:48.633535 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b4ea39d7-5c66-4bce-b7e0-9ede25672d56 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:48.634085 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b4ea39d7-5c66-4bce-b7e0-9ede25672d56 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:48.638564 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:06:48.800519 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-b4ea39d7-5c66-4bce-b7e0-9ede25672d56 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:48.820785 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-b4ea39d7-5c66-4bce-b7e0-9ede25672d56 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1714 microversion: 2.1 time: 0.200670 Jul 25 23:06:48.821719 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 205/409] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:48 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1714 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:49.119844 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c8a57487-db25-4e15-9aae-fca73b7b7b3c tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:49.135367 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c8a57487-db25-4e15-9aae-fca73b7b7b3c tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:49.135367 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c8a57487-db25-4e15-9aae-fca73b7b7b3c tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:49.135367 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c8a57487-db25-4e15-9aae-fca73b7b7b3c tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:49.135367 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c8a57487-db25-4e15-9aae-fca73b7b7b3c tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:49.136037 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c8a57487-db25-4e15-9aae-fca73b7b7b3c tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:49.365595 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c8a57487-db25-4e15-9aae-fca73b7b7b3c tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:49.373627 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c8a57487-db25-4e15-9aae-fca73b7b7b3c tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5" status: 200 len: 1508 microversion: 2.1 time: 0.258357 Jul 25 23:06:49.376146 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 205/410] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:06:49 2022] GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5 => generated 1508 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:06:49.612563 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-d3b478a9-5b18-4d26-967c-2cf5b7392af7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:49.613270 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-d3b478a9-5b18-4d26-967c-2cf5b7392af7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:49.621458 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d3b478a9-5b18-4d26-967c-2cf5b7392af7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:49.621995 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d3b478a9-5b18-4d26-967c-2cf5b7392af7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:49.622887 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d3b478a9-5b18-4d26-967c-2cf5b7392af7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:49.623569 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d3b478a9-5b18-4d26-967c-2cf5b7392af7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:49.762368 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-d3b478a9-5b18-4d26-967c-2cf5b7392af7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:49.771275 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-d3b478a9-5b18-4d26-967c-2cf5b7392af7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:49.772853 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-d3b478a9-5b18-4d26-967c-2cf5b7392af7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:49.774084 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-d3b478a9-5b18-4d26-967c-2cf5b7392af7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1753 microversion: 2.20 time: 0.165997 Jul 25 23:06:49.779276 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 206/411] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:49 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:06:50.799668 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-27a6eea4-5def-4269-89eb-3b986f6b9ce1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:50.801077 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-27a6eea4-5def-4269-89eb-3b986f6b9ce1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:50.809321 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-27a6eea4-5def-4269-89eb-3b986f6b9ce1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:50.809764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-27a6eea4-5def-4269-89eb-3b986f6b9ce1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:50.810533 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-27a6eea4-5def-4269-89eb-3b986f6b9ce1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:50.810960 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-27a6eea4-5def-4269-89eb-3b986f6b9ce1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:50.951127 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-27a6eea4-5def-4269-89eb-3b986f6b9ce1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:50.960202 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-27a6eea4-5def-4269-89eb-3b986f6b9ce1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:50.962958 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-27a6eea4-5def-4269-89eb-3b986f6b9ce1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:50.964121 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-27a6eea4-5def-4269-89eb-3b986f6b9ce1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1753 microversion: 2.20 time: 0.168797 Jul 25 23:06:50.964684 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 206/412] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:50 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:06:51.988037 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-1688ccc7-713f-4594-94ad-d38ca2494dcc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:51.989358 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-1688ccc7-713f-4594-94ad-d38ca2494dcc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:51.997366 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1688ccc7-713f-4594-94ad-d38ca2494dcc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:51.998593 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1688ccc7-713f-4594-94ad-d38ca2494dcc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:51.999703 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1688ccc7-713f-4594-94ad-d38ca2494dcc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:52.000423 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1688ccc7-713f-4594-94ad-d38ca2494dcc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:52.475474 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-1688ccc7-713f-4594-94ad-d38ca2494dcc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:52.484736 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-1688ccc7-713f-4594-94ad-d38ca2494dcc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:52.486293 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-1688ccc7-713f-4594-94ad-d38ca2494dcc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:52.487558 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-1688ccc7-713f-4594-94ad-d38ca2494dcc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.503458 Jul 25 23:06:52.488253 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 207/413] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:51 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:06:53.511949 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d2d49513-e553-40bc-af9f-925015eda3e2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:53.517023 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-d2d49513-e553-40bc-af9f-925015eda3e2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:53.519793 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d2d49513-e553-40bc-af9f-925015eda3e2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:53.520322 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d2d49513-e553-40bc-af9f-925015eda3e2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:53.521182 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d2d49513-e553-40bc-af9f-925015eda3e2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:53.521671 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d2d49513-e553-40bc-af9f-925015eda3e2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:53.675624 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-d2d49513-e553-40bc-af9f-925015eda3e2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:53.684567 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-d2d49513-e553-40bc-af9f-925015eda3e2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:53.686172 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-d2d49513-e553-40bc-af9f-925015eda3e2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:53.687314 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-d2d49513-e553-40bc-af9f-925015eda3e2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.179122 Jul 25 23:06:53.688092 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 207/414] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:53 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:06:54.712560 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-5824264f-62de-4154-830e-c0921eaa4379 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:54.714189 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-5824264f-62de-4154-830e-c0921eaa4379 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:54.724271 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5824264f-62de-4154-830e-c0921eaa4379 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:54.725109 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5824264f-62de-4154-830e-c0921eaa4379 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:54.730055 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5824264f-62de-4154-830e-c0921eaa4379 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:54.730055 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5824264f-62de-4154-830e-c0921eaa4379 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:54.907024 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-5824264f-62de-4154-830e-c0921eaa4379 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:54.925820 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-5824264f-62de-4154-830e-c0921eaa4379 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:54.927324 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-5824264f-62de-4154-830e-c0921eaa4379 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:54.928485 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-5824264f-62de-4154-830e-c0921eaa4379 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.220618 Jul 25 23:06:54.929041 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 208/415] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:54 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:06:55.953497 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-7586a6b4-cac7-40b2-b1b6-8d0d1e66e97c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:55.954371 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-7586a6b4-cac7-40b2-b1b6-8d0d1e66e97c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:55.962090 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7586a6b4-cac7-40b2-b1b6-8d0d1e66e97c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:55.962837 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7586a6b4-cac7-40b2-b1b6-8d0d1e66e97c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:55.963806 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7586a6b4-cac7-40b2-b1b6-8d0d1e66e97c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:55.964437 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7586a6b4-cac7-40b2-b1b6-8d0d1e66e97c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:56.211994 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7586a6b4-cac7-40b2-b1b6-8d0d1e66e97c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:56.221231 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7586a6b4-cac7-40b2-b1b6-8d0d1e66e97c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:56.222794 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7586a6b4-cac7-40b2-b1b6-8d0d1e66e97c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:56.224001 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-7586a6b4-cac7-40b2-b1b6-8d0d1e66e97c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.274892 Jul 25 23:06:56.224787 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 208/416] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:55 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:06:57.249622 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-1d6e6874-9306-468f-9add-8a01957b4856 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:57.250271 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-1d6e6874-9306-468f-9add-8a01957b4856 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:57.257145 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1d6e6874-9306-468f-9add-8a01957b4856 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:57.257988 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1d6e6874-9306-468f-9add-8a01957b4856 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:57.258753 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1d6e6874-9306-468f-9add-8a01957b4856 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:57.259183 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1d6e6874-9306-468f-9add-8a01957b4856 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:57.416125 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-1d6e6874-9306-468f-9add-8a01957b4856 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:57.432164 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-1d6e6874-9306-468f-9add-8a01957b4856 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:57.434043 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-1d6e6874-9306-468f-9add-8a01957b4856 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:57.435241 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-1d6e6874-9306-468f-9add-8a01957b4856 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.190416 Jul 25 23:06:57.435966 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 209/417] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:57 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:06:58.459850 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-221d5e58-2fc6-4943-bf9c-3e9ce5c395f0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:58.460945 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-221d5e58-2fc6-4943-bf9c-3e9ce5c395f0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:58.469664 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-221d5e58-2fc6-4943-bf9c-3e9ce5c395f0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:58.469664 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-221d5e58-2fc6-4943-bf9c-3e9ce5c395f0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:58.470144 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-221d5e58-2fc6-4943-bf9c-3e9ce5c395f0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:58.470693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-221d5e58-2fc6-4943-bf9c-3e9ce5c395f0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:58.635475 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-221d5e58-2fc6-4943-bf9c-3e9ce5c395f0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:58.648790 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-221d5e58-2fc6-4943-bf9c-3e9ce5c395f0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:58.651156 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-221d5e58-2fc6-4943-bf9c-3e9ce5c395f0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:58.652700 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-221d5e58-2fc6-4943-bf9c-3e9ce5c395f0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.196780 Jul 25 23:06:58.666264 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 209/418] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:58 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:06:59.677853 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-4ddf364a-ad4a-4609-b877-bd0810555f57 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:06:59.678679 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-4ddf364a-ad4a-4609-b877-bd0810555f57 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:06:59.688829 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4ddf364a-ad4a-4609-b877-bd0810555f57 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:59.689536 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4ddf364a-ad4a-4609-b877-bd0810555f57 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:59.690481 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4ddf364a-ad4a-4609-b877-bd0810555f57 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:06:59.690908 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4ddf364a-ad4a-4609-b877-bd0810555f57 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:06:59.896010 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-4ddf364a-ad4a-4609-b877-bd0810555f57 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:59.905720 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-4ddf364a-ad4a-4609-b877-bd0810555f57 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:59.907612 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-4ddf364a-ad4a-4609-b877-bd0810555f57 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:06:59.908787 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-4ddf364a-ad4a-4609-b877-bd0810555f57 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.235120 Jul 25 23:06:59.909363 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 210/419] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:06:59 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:07:00.934145 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-7327c3f9-0ba3-47b0-8ff0-5e72f76482a7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:00.934763 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-7327c3f9-0ba3-47b0-8ff0-5e72f76482a7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:00.937363 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=92 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:07:00.943431 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7327c3f9-0ba3-47b0-8ff0-5e72f76482a7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:00.946301 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7327c3f9-0ba3-47b0-8ff0-5e72f76482a7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:00.946301 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7327c3f9-0ba3-47b0-8ff0-5e72f76482a7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:00.946301 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7327c3f9-0ba3-47b0-8ff0-5e72f76482a7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:01.094951 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7327c3f9-0ba3-47b0-8ff0-5e72f76482a7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:01.104551 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7327c3f9-0ba3-47b0-8ff0-5e72f76482a7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:01.106118 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7327c3f9-0ba3-47b0-8ff0-5e72f76482a7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:01.107285 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-7327c3f9-0ba3-47b0-8ff0-5e72f76482a7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.177110 Jul 25 23:07:01.113581 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 210/420] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:00 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:07:02.132760 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-c3421ba0-629a-40d6-8b11-49638129a48f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:02.134137 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-c3421ba0-629a-40d6-8b11-49638129a48f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:02.141020 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c3421ba0-629a-40d6-8b11-49638129a48f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:02.141551 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c3421ba0-629a-40d6-8b11-49638129a48f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:02.142474 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c3421ba0-629a-40d6-8b11-49638129a48f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:02.142996 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c3421ba0-629a-40d6-8b11-49638129a48f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:02.320483 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-c3421ba0-629a-40d6-8b11-49638129a48f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:02.320483 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-c3421ba0-629a-40d6-8b11-49638129a48f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:02.322605 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-c3421ba0-629a-40d6-8b11-49638129a48f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:02.322939 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-c3421ba0-629a-40d6-8b11-49638129a48f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.194917 Jul 25 23:07:02.323827 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 211/421] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:02 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:07:03.349287 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f4ba629c-1dbd-42fb-8359-52f534fe8fa2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:03.349893 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f4ba629c-1dbd-42fb-8359-52f534fe8fa2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:03.356510 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f4ba629c-1dbd-42fb-8359-52f534fe8fa2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:03.356949 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f4ba629c-1dbd-42fb-8359-52f534fe8fa2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:03.357737 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f4ba629c-1dbd-42fb-8359-52f534fe8fa2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:03.358162 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f4ba629c-1dbd-42fb-8359-52f534fe8fa2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:03.497608 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f4ba629c-1dbd-42fb-8359-52f534fe8fa2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:03.506440 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f4ba629c-1dbd-42fb-8359-52f534fe8fa2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:03.509012 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f4ba629c-1dbd-42fb-8359-52f534fe8fa2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:03.509723 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f4ba629c-1dbd-42fb-8359-52f534fe8fa2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.164489 Jul 25 23:07:03.510265 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 211/422] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:03 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:07:03.868195 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-3fdd8fc6-0124-4fa9-8b3b-cf392745db35 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:07:03.870503 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-3fdd8fc6-0124-4fa9-8b3b-cf392745db35 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:03.872839 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_api:SELECT=68 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:07:03.877829 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3fdd8fc6-0124-4fa9-8b3b-cf392745db35 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:03.878358 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3fdd8fc6-0124-4fa9-8b3b-cf392745db35 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:03.879117 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3fdd8fc6-0124-4fa9-8b3b-cf392745db35 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:03.879545 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3fdd8fc6-0124-4fa9-8b3b-cf392745db35 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:04.183602 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-3fdd8fc6-0124-4fa9-8b3b-cf392745db35 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "POST /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8/action" status: 202 len: 0 microversion: 2.1 time: 0.319909 Jul 25 23:07:04.184423 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 212/423] 10.222.0.55 () {60 vars in 1278 bytes} [Mon Jul 25 23:07:03 2022] POST /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 23:07:04.192385 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4141927a-671e-4220-a93e-33404538731c tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:04.192985 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4141927a-671e-4220-a93e-33404538731c tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:04.199775 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4141927a-671e-4220-a93e-33404538731c tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:04.200189 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4141927a-671e-4220-a93e-33404538731c tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:04.200949 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4141927a-671e-4220-a93e-33404538731c tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:04.201417 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4141927a-671e-4220-a93e-33404538731c tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:04.356064 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4141927a-671e-4220-a93e-33404538731c tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:04.359456 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:07:04.364242 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4141927a-671e-4220-a93e-33404538731c tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1751 microversion: 2.1 time: 0.175801 Jul 25 23:07:04.364817 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 212/424] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:04 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1751 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:07:04.533579 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-5edb744b-b105-4301-8556-d50222d1b623 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:04.534190 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-5edb744b-b105-4301-8556-d50222d1b623 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:04.541450 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5edb744b-b105-4301-8556-d50222d1b623 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:04.541893 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5edb744b-b105-4301-8556-d50222d1b623 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:04.542677 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5edb744b-b105-4301-8556-d50222d1b623 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:04.543112 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5edb744b-b105-4301-8556-d50222d1b623 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:04.680798 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-5edb744b-b105-4301-8556-d50222d1b623 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:04.689199 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-5edb744b-b105-4301-8556-d50222d1b623 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:04.690701 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-5edb744b-b105-4301-8556-d50222d1b623 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:04.691847 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-5edb744b-b105-4301-8556-d50222d1b623 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.162621 Jul 25 23:07:04.692391 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 213/425] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:04 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:07:05.387834 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-2742c240-78dd-41c5-b588-843b4f0ca8c8 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:05.389033 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-2742c240-78dd-41c5-b588-843b4f0ca8c8 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:05.396755 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2742c240-78dd-41c5-b588-843b4f0ca8c8 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:05.397491 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2742c240-78dd-41c5-b588-843b4f0ca8c8 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:05.399623 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2742c240-78dd-41c5-b588-843b4f0ca8c8 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:05.403439 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2742c240-78dd-41c5-b588-843b4f0ca8c8 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:05.650122 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-2742c240-78dd-41c5-b588-843b4f0ca8c8 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:05.659160 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-2742c240-78dd-41c5-b588-843b4f0ca8c8 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1751 microversion: 2.1 time: 0.276840 Jul 25 23:07:05.659985 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 213/426] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:05 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1751 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:07:05.715361 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-5f346ec7-4a34-4d5c-9572-5a965b22b748 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:05.716025 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-5f346ec7-4a34-4d5c-9572-5a965b22b748 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:05.722467 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5f346ec7-4a34-4d5c-9572-5a965b22b748 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:05.722912 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5f346ec7-4a34-4d5c-9572-5a965b22b748 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:05.723679 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5f346ec7-4a34-4d5c-9572-5a965b22b748 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:05.724112 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5f346ec7-4a34-4d5c-9572-5a965b22b748 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:05.858574 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-5f346ec7-4a34-4d5c-9572-5a965b22b748 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:05.867391 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-5f346ec7-4a34-4d5c-9572-5a965b22b748 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:05.868920 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-5f346ec7-4a34-4d5c-9572-5a965b22b748 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:05.870113 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-5f346ec7-4a34-4d5c-9572-5a965b22b748 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.158616 Jul 25 23:07:05.870675 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 214/427] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:05 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:07:06.683272 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d32ae3ba-5cd1-4d9b-aa32-ef032a71f88a tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:06.683795 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-d32ae3ba-5cd1-4d9b-aa32-ef032a71f88a tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:06.691327 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d32ae3ba-5cd1-4d9b-aa32-ef032a71f88a tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:06.691771 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d32ae3ba-5cd1-4d9b-aa32-ef032a71f88a tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:06.692691 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d32ae3ba-5cd1-4d9b-aa32-ef032a71f88a tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:06.693042 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d32ae3ba-5cd1-4d9b-aa32-ef032a71f88a tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:06.841565 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-d32ae3ba-5cd1-4d9b-aa32-ef032a71f88a tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:06.850080 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-d32ae3ba-5cd1-4d9b-aa32-ef032a71f88a tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1756 microversion: 2.1 time: 0.172466 Jul 25 23:07:06.851426 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 214/428] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:06 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:07:06.893933 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-c7fcecb9-2bc0-424c-b5e1-f239f8c968ad tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:06.894499 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-c7fcecb9-2bc0-424c-b5e1-f239f8c968ad tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:06.901335 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c7fcecb9-2bc0-424c-b5e1-f239f8c968ad tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:06.901774 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c7fcecb9-2bc0-424c-b5e1-f239f8c968ad tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:06.902538 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c7fcecb9-2bc0-424c-b5e1-f239f8c968ad tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:06.902963 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c7fcecb9-2bc0-424c-b5e1-f239f8c968ad tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:07.039979 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-c7fcecb9-2bc0-424c-b5e1-f239f8c968ad tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:07.048511 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-c7fcecb9-2bc0-424c-b5e1-f239f8c968ad tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:07.050074 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-c7fcecb9-2bc0-424c-b5e1-f239f8c968ad tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:07.051704 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-c7fcecb9-2bc0-424c-b5e1-f239f8c968ad tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.161410 Jul 25 23:07:07.052253 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 215/429] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:06 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:07:07.871921 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-05fa81ee-2abe-4180-a908-a9b425e818b4 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:07.872549 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-05fa81ee-2abe-4180-a908-a9b425e818b4 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:07.879073 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-05fa81ee-2abe-4180-a908-a9b425e818b4 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:07.879507 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-05fa81ee-2abe-4180-a908-a9b425e818b4 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:07.880264 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-05fa81ee-2abe-4180-a908-a9b425e818b4 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:07.880687 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-05fa81ee-2abe-4180-a908-a9b425e818b4 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:08.022683 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-05fa81ee-2abe-4180-a908-a9b425e818b4 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:08.031124 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-05fa81ee-2abe-4180-a908-a9b425e818b4 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1756 microversion: 2.1 time: 0.163074 Jul 25 23:07:08.031688 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 215/430] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:07 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:07:08.076066 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-6fc33e1f-0a50-4073-bab8-a8110d91bd67 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:08.076659 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-6fc33e1f-0a50-4073-bab8-a8110d91bd67 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:08.083515 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6fc33e1f-0a50-4073-bab8-a8110d91bd67 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:08.083954 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6fc33e1f-0a50-4073-bab8-a8110d91bd67 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:08.084710 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6fc33e1f-0a50-4073-bab8-a8110d91bd67 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:08.085194 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6fc33e1f-0a50-4073-bab8-a8110d91bd67 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:08.217642 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-6fc33e1f-0a50-4073-bab8-a8110d91bd67 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:08.227211 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-6fc33e1f-0a50-4073-bab8-a8110d91bd67 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:08.228708 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-6fc33e1f-0a50-4073-bab8-a8110d91bd67 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:08.229904 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-6fc33e1f-0a50-4073-bab8-a8110d91bd67 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.157713 Jul 25 23:07:08.230580 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 216/431] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:08 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:07:09.052563 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-aebc31f4-7834-4da3-982b-48f88c45927f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:09.053301 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-aebc31f4-7834-4da3-982b-48f88c45927f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:09.059838 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-aebc31f4-7834-4da3-982b-48f88c45927f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:09.060277 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-aebc31f4-7834-4da3-982b-48f88c45927f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:09.061025 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-aebc31f4-7834-4da3-982b-48f88c45927f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:09.061482 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-aebc31f4-7834-4da3-982b-48f88c45927f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:09.202564 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-aebc31f4-7834-4da3-982b-48f88c45927f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:09.210644 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-aebc31f4-7834-4da3-982b-48f88c45927f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1756 microversion: 2.1 time: 0.161935 Jul 25 23:07:09.211838 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 216/432] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:09 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:07:09.253611 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-76b92ea1-29fe-4dc1-813e-a1594b361d47 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:09.254237 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-76b92ea1-29fe-4dc1-813e-a1594b361d47 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:09.263188 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-76b92ea1-29fe-4dc1-813e-a1594b361d47 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:09.263660 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-76b92ea1-29fe-4dc1-813e-a1594b361d47 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:09.264940 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-76b92ea1-29fe-4dc1-813e-a1594b361d47 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:09.265907 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-76b92ea1-29fe-4dc1-813e-a1594b361d47 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:09.406256 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-76b92ea1-29fe-4dc1-813e-a1594b361d47 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:09.414705 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-76b92ea1-29fe-4dc1-813e-a1594b361d47 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:09.416207 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-76b92ea1-29fe-4dc1-813e-a1594b361d47 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:09.417437 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-76b92ea1-29fe-4dc1-813e-a1594b361d47 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.167643 Jul 25 23:07:09.418001 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 217/433] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:09 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:07:10.232525 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-9e21b805-8a66-4421-8eab-662a31e84150 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:10.233103 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-9e21b805-8a66-4421-8eab-662a31e84150 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:10.239673 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9e21b805-8a66-4421-8eab-662a31e84150 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:10.240212 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9e21b805-8a66-4421-8eab-662a31e84150 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:10.240865 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9e21b805-8a66-4421-8eab-662a31e84150 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:10.241351 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9e21b805-8a66-4421-8eab-662a31e84150 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:10.398110 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9e21b805-8a66-4421-8eab-662a31e84150 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:10.406986 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-9e21b805-8a66-4421-8eab-662a31e84150 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1756 microversion: 2.1 time: 0.178250 Jul 25 23:07:10.407569 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 217/434] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:10 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:07:10.441098 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-1a4ccd75-1211-477e-80e3-4b36425804e9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:10.441714 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-1a4ccd75-1211-477e-80e3-4b36425804e9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:10.448370 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1a4ccd75-1211-477e-80e3-4b36425804e9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:10.448810 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1a4ccd75-1211-477e-80e3-4b36425804e9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:10.449592 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1a4ccd75-1211-477e-80e3-4b36425804e9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:10.450025 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1a4ccd75-1211-477e-80e3-4b36425804e9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:10.583024 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-1a4ccd75-1211-477e-80e3-4b36425804e9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:10.592422 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-1a4ccd75-1211-477e-80e3-4b36425804e9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:10.593955 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-1a4ccd75-1211-477e-80e3-4b36425804e9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:10.595102 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-1a4ccd75-1211-477e-80e3-4b36425804e9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.157998 Jul 25 23:07:10.595647 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 218/435] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:10 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:07:11.406664 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-38b53f2a-a937-497d-b4b1-4d0791f85c01 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "506ad727-ee07-4786-a41a-2887091cb03e", "device": "/dev/sdb"}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:07:11.409599 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-38b53f2a-a937-497d-b4b1-4d0791f85c01 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:11.416643 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-38b53f2a-a937-497d-b4b1-4d0791f85c01 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:11.417074 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-38b53f2a-a937-497d-b4b1-4d0791f85c01 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:11.417870 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-38b53f2a-a937-497d-b4b1-4d0791f85c01 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:11.418302 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-38b53f2a-a937-497d-b4b1-4d0791f85c01 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:11.428979 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-ae55896f-6d8b-4dc6-bdc2-09779620a299 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:11.429629 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-ae55896f-6d8b-4dc6-bdc2-09779620a299 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:11.436411 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ae55896f-6d8b-4dc6-bdc2-09779620a299 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:11.436853 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ae55896f-6d8b-4dc6-bdc2-09779620a299 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:11.437649 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ae55896f-6d8b-4dc6-bdc2-09779620a299 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:11.438077 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ae55896f-6d8b-4dc6-bdc2-09779620a299 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:11.590770 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-ae55896f-6d8b-4dc6-bdc2-09779620a299 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:11.599179 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-ae55896f-6d8b-4dc6-bdc2-09779620a299 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1756 microversion: 2.1 time: 0.173867 Jul 25 23:07:11.599685 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 219/436] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:11 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:07:11.619288 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-8444efe1-17f2-4643-adff-803e299ac033 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:11.619876 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-8444efe1-17f2-4643-adff-803e299ac033 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:11.626017 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8444efe1-17f2-4643-adff-803e299ac033 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:11.626450 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8444efe1-17f2-4643-adff-803e299ac033 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:11.627193 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8444efe1-17f2-4643-adff-803e299ac033 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:11.627614 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8444efe1-17f2-4643-adff-803e299ac033 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:11.757267 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-8444efe1-17f2-4643-adff-803e299ac033 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:11.761063 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:07:11.766472 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-8444efe1-17f2-4643-adff-803e299ac033 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:11.767963 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-8444efe1-17f2-4643-adff-803e299ac033 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:11.769105 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-8444efe1-17f2-4643-adff-803e299ac033 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.154369 Jul 25 23:07:11.769673 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 220/437] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:11 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:07:12.280959 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-38b53f2a-a937-497d-b4b1-4d0791f85c01 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "POST /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.878025 Jul 25 23:07:12.281655 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 218/438] 10.222.0.55 () {60 vars in 1323 bytes} [Mon Jul 25 23:07:11 2022] POST /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5/os-volume_attachments => generated 194 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:07:12.622031 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-272aeeb3-4b96-4015-be53-b5da384b1d0b tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:12.623674 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-272aeeb3-4b96-4015-be53-b5da384b1d0b tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:12.630127 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-272aeeb3-4b96-4015-be53-b5da384b1d0b tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:12.630573 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-272aeeb3-4b96-4015-be53-b5da384b1d0b tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:12.631336 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-272aeeb3-4b96-4015-be53-b5da384b1d0b tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:12.631774 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-272aeeb3-4b96-4015-be53-b5da384b1d0b tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:12.782600 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-272aeeb3-4b96-4015-be53-b5da384b1d0b tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:12.791372 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-272aeeb3-4b96-4015-be53-b5da384b1d0b tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1756 microversion: 2.1 time: 0.174254 Jul 25 23:07:12.791938 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 221/439] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:12 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:07:12.794388 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-da800e67-2a3b-4b60-8390-529ff09397b5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:12.795091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-da800e67-2a3b-4b60-8390-529ff09397b5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:12.801699 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-da800e67-2a3b-4b60-8390-529ff09397b5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:12.802150 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-da800e67-2a3b-4b60-8390-529ff09397b5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:12.802917 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-da800e67-2a3b-4b60-8390-529ff09397b5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:12.803352 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-da800e67-2a3b-4b60-8390-529ff09397b5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:12.938217 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-da800e67-2a3b-4b60-8390-529ff09397b5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:12.947067 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-da800e67-2a3b-4b60-8390-529ff09397b5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:12.948601 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-da800e67-2a3b-4b60-8390-529ff09397b5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:12.949774 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-da800e67-2a3b-4b60-8390-529ff09397b5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.160264 Jul 25 23:07:12.950349 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 219/440] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:12 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:07:13.812397 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-57bc4086-492c-4641-b4c3-099bcdb5cf69 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:13.813007 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-57bc4086-492c-4641-b4c3-099bcdb5cf69 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:13.819590 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-57bc4086-492c-4641-b4c3-099bcdb5cf69 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:13.820037 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-57bc4086-492c-4641-b4c3-099bcdb5cf69 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:13.820824 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-57bc4086-492c-4641-b4c3-099bcdb5cf69 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:13.821283 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-57bc4086-492c-4641-b4c3-099bcdb5cf69 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:13.972753 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-69f1812c-2d2b-476c-a4dd-468f070adb4b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:13.973622 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-69f1812c-2d2b-476c-a4dd-468f070adb4b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:13.981230 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-69f1812c-2d2b-476c-a4dd-468f070adb4b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:13.981677 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-69f1812c-2d2b-476c-a4dd-468f070adb4b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:13.987191 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-69f1812c-2d2b-476c-a4dd-468f070adb4b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:13.987744 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-69f1812c-2d2b-476c-a4dd-468f070adb4b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:13.997379 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-57bc4086-492c-4641-b4c3-099bcdb5cf69 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:14.019116 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-57bc4086-492c-4641-b4c3-099bcdb5cf69 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1756 microversion: 2.1 time: 0.204443 Jul 25 23:07:14.020498 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 222/441] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:13 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1756 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:07:14.152231 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-69f1812c-2d2b-476c-a4dd-468f070adb4b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:14.161907 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-69f1812c-2d2b-476c-a4dd-468f070adb4b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:14.163480 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-69f1812c-2d2b-476c-a4dd-468f070adb4b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:14.165416 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-69f1812c-2d2b-476c-a4dd-468f070adb4b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.196963 Jul 25 23:07:14.171239 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 220/442] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:13 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:07:15.043908 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-1338d6d9-f26a-4308-8d30-ea671b85396f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:15.044509 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-1338d6d9-f26a-4308-8d30-ea671b85396f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:15.051430 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1338d6d9-f26a-4308-8d30-ea671b85396f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:15.051876 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1338d6d9-f26a-4308-8d30-ea671b85396f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:15.052785 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1338d6d9-f26a-4308-8d30-ea671b85396f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:15.053059 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1338d6d9-f26a-4308-8d30-ea671b85396f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:15.193587 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-2050d8da-b663-42cb-a537-81b24572ccbe tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:15.194194 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-2050d8da-b663-42cb-a537-81b24572ccbe tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:15.198172 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-1338d6d9-f26a-4308-8d30-ea671b85396f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:15.200746 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2050d8da-b663-42cb-a537-81b24572ccbe tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:15.201231 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2050d8da-b663-42cb-a537-81b24572ccbe tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:15.201997 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2050d8da-b663-42cb-a537-81b24572ccbe tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:15.202425 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2050d8da-b663-42cb-a537-81b24572ccbe tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:15.206386 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-1338d6d9-f26a-4308-8d30-ea671b85396f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1756 microversion: 2.1 time: 0.166243 Jul 25 23:07:15.206951 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 223/443] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:15 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:07:15.348997 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-2050d8da-b663-42cb-a537-81b24572ccbe tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:15.358217 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-2050d8da-b663-42cb-a537-81b24572ccbe tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:15.359749 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-2050d8da-b663-42cb-a537-81b24572ccbe tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:15.360900 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-2050d8da-b663-42cb-a537-81b24572ccbe tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.171151 Jul 25 23:07:15.361506 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 221/444] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:15 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:07:16.227911 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-3a38ab98-3f4a-4a5b-ad0b-a33301aa2683 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:16.228535 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-3a38ab98-3f4a-4a5b-ad0b-a33301aa2683 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:16.235033 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3a38ab98-3f4a-4a5b-ad0b-a33301aa2683 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:16.235474 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3a38ab98-3f4a-4a5b-ad0b-a33301aa2683 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:16.236226 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3a38ab98-3f4a-4a5b-ad0b-a33301aa2683 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:16.236652 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3a38ab98-3f4a-4a5b-ad0b-a33301aa2683 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:16.383618 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-3a38ab98-3f4a-4a5b-ad0b-a33301aa2683 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:16.387064 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0ad10e3b-46ca-452f-a2a6-003e653b3a39 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:16.387538 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-0ad10e3b-46ca-452f-a2a6-003e653b3a39 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:16.392761 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-3a38ab98-3f4a-4a5b-ad0b-a33301aa2683 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1756 microversion: 2.1 time: 0.169151 Jul 25 23:07:16.393394 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 224/445] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:16 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:07:16.393716 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0ad10e3b-46ca-452f-a2a6-003e653b3a39 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:16.394158 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0ad10e3b-46ca-452f-a2a6-003e653b3a39 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:16.394928 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0ad10e3b-46ca-452f-a2a6-003e653b3a39 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:16.395359 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0ad10e3b-46ca-452f-a2a6-003e653b3a39 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:16.531542 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-0ad10e3b-46ca-452f-a2a6-003e653b3a39 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:16.541162 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-0ad10e3b-46ca-452f-a2a6-003e653b3a39 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:16.542811 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-0ad10e3b-46ca-452f-a2a6-003e653b3a39 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:16.544054 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-0ad10e3b-46ca-452f-a2a6-003e653b3a39 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.162175 Jul 25 23:07:16.544834 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 222/446] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:16 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:07:17.414839 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-f6cb4906-ade6-4026-b7b8-6b04346437b8 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:17.415361 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-f6cb4906-ade6-4026-b7b8-6b04346437b8 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:17.422065 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f6cb4906-ade6-4026-b7b8-6b04346437b8 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:17.425793 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f6cb4906-ade6-4026-b7b8-6b04346437b8 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:17.425793 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f6cb4906-ade6-4026-b7b8-6b04346437b8 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:17.425793 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f6cb4906-ade6-4026-b7b8-6b04346437b8 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:17.568112 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-3c163aea-fa60-4496-8bfb-a0c6ba597a20 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:17.568856 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-3c163aea-fa60-4496-8bfb-a0c6ba597a20 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:17.572366 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-f6cb4906-ade6-4026-b7b8-6b04346437b8 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:17.576596 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3c163aea-fa60-4496-8bfb-a0c6ba597a20 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:17.577243 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3c163aea-fa60-4496-8bfb-a0c6ba597a20 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:17.578029 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3c163aea-fa60-4496-8bfb-a0c6ba597a20 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:17.578461 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3c163aea-fa60-4496-8bfb-a0c6ba597a20 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:17.581420 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-f6cb4906-ade6-4026-b7b8-6b04346437b8 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1756 microversion: 2.1 time: 0.170623 Jul 25 23:07:17.582246 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 225/447] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:17 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:07:17.709697 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-3c163aea-fa60-4496-8bfb-a0c6ba597a20 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:17.718942 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-3c163aea-fa60-4496-8bfb-a0c6ba597a20 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:17.720510 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-3c163aea-fa60-4496-8bfb-a0c6ba597a20 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:17.721700 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-3c163aea-fa60-4496-8bfb-a0c6ba597a20 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.157646 Jul 25 23:07:17.722299 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 223/448] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:17 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:07:18.604034 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-932dda5f-6cc8-4e1c-ae2e-60976f719690 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:18.604636 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-932dda5f-6cc8-4e1c-ae2e-60976f719690 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:18.611872 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-932dda5f-6cc8-4e1c-ae2e-60976f719690 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:18.612314 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-932dda5f-6cc8-4e1c-ae2e-60976f719690 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:18.613130 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-932dda5f-6cc8-4e1c-ae2e-60976f719690 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:18.613571 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-932dda5f-6cc8-4e1c-ae2e-60976f719690 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:18.745326 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-56d59429-476e-41d7-bc38-c30776ac7ceb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:18.746030 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-56d59429-476e-41d7-bc38-c30776ac7ceb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:18.752776 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-56d59429-476e-41d7-bc38-c30776ac7ceb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:18.753262 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-56d59429-476e-41d7-bc38-c30776ac7ceb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:18.754035 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-56d59429-476e-41d7-bc38-c30776ac7ceb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:18.754469 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-56d59429-476e-41d7-bc38-c30776ac7ceb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:18.769965 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-932dda5f-6cc8-4e1c-ae2e-60976f719690 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:18.775133 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-932dda5f-6cc8-4e1c-ae2e-60976f719690 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1756 microversion: 2.1 time: 0.175533 Jul 25 23:07:18.775708 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 226/449] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:18 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:07:18.886851 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-56d59429-476e-41d7-bc38-c30776ac7ceb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:18.895305 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-56d59429-476e-41d7-bc38-c30776ac7ceb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:18.896793 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-56d59429-476e-41d7-bc38-c30776ac7ceb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:18.897965 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-56d59429-476e-41d7-bc38-c30776ac7ceb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.157128 Jul 25 23:07:18.898571 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 224/450] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:18 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:07:19.416521 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-84984cf1-1c21-41e3-a62a-e121e479d0af req-0029cae2-d2cf-4a1a-840d-0b9a240220a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e78f6354-b88d-45a6-817b-4ef206d07d33", "name": "network-vif-plugged", "status": "completed", "tag": "b7e5b654-c700-4c79-966e-9953941ea57a"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:07:19.426619 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-84984cf1-1c21-41e3-a62a-e121e479d0af req-0029cae2-d2cf-4a1a-840d-0b9a240220a9 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:19.427079 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-84984cf1-1c21-41e3-a62a-e121e479d0af req-0029cae2-d2cf-4a1a-840d-0b9a240220a9 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:19.439091 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-84984cf1-1c21-41e3-a62a-e121e479d0af req-0029cae2-d2cf-4a1a-840d-0b9a240220a9 service nova] Creating event network-vif-plugged:b7e5b654-c700-4c79-966e-9953941ea57a for instance e78f6354-b88d-45a6-817b-4ef206d07d33 on hv-cinder-79760 Jul 25 23:07:19.444364 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-84984cf1-1c21-41e3-a62a-e121e479d0af req-0029cae2-d2cf-4a1a-840d-0b9a240220a9 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032201 Jul 25 23:07:19.444949 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 227/451] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:07:19.797730 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e35b3876-9de3-4061-9c7e-8a55fb90337b tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:19.798260 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e35b3876-9de3-4061-9c7e-8a55fb90337b tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:19.804991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e35b3876-9de3-4061-9c7e-8a55fb90337b tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:19.805467 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e35b3876-9de3-4061-9c7e-8a55fb90337b tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:19.806233 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e35b3876-9de3-4061-9c7e-8a55fb90337b tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:19.806664 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e35b3876-9de3-4061-9c7e-8a55fb90337b tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:19.922502 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-a13bfa57-d1ca-42ab-9c7e-3c291bcced64 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:19.923233 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-a13bfa57-d1ca-42ab-9c7e-3c291bcced64 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:19.930534 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a13bfa57-d1ca-42ab-9c7e-3c291bcced64 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:19.931014 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a13bfa57-d1ca-42ab-9c7e-3c291bcced64 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:19.931792 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a13bfa57-d1ca-42ab-9c7e-3c291bcced64 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:19.932223 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a13bfa57-d1ca-42ab-9c7e-3c291bcced64 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:19.957285 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e35b3876-9de3-4061-9c7e-8a55fb90337b tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:19.965978 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e35b3876-9de3-4061-9c7e-8a55fb90337b tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1756 microversion: 2.1 time: 0.171966 Jul 25 23:07:19.966616 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 225/452] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:19 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:07:20.066913 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-a13bfa57-d1ca-42ab-9c7e-3c291bcced64 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:20.075611 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-a13bfa57-d1ca-42ab-9c7e-3c291bcced64 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:20.077095 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-a13bfa57-d1ca-42ab-9c7e-3c291bcced64 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:20.078252 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-a13bfa57-d1ca-42ab-9c7e-3c291bcced64 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.160008 Jul 25 23:07:20.078801 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 228/453] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:19 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:07:20.989352 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-bb5964f7-baec-44a7-809b-36d1d2312216 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:20.989352 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-bb5964f7-baec-44a7-809b-36d1d2312216 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:20.994743 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bb5964f7-baec-44a7-809b-36d1d2312216 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:20.995192 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bb5964f7-baec-44a7-809b-36d1d2312216 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:20.995966 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bb5964f7-baec-44a7-809b-36d1d2312216 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:20.996423 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bb5964f7-baec-44a7-809b-36d1d2312216 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:21.103259 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-ebc416e8-1b01-4791-bc58-f885929503f3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:21.104048 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-ebc416e8-1b01-4791-bc58-f885929503f3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:21.111271 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ebc416e8-1b01-4791-bc58-f885929503f3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:21.111721 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ebc416e8-1b01-4791-bc58-f885929503f3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:21.112539 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ebc416e8-1b01-4791-bc58-f885929503f3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:21.112968 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ebc416e8-1b01-4791-bc58-f885929503f3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:21.145422 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-bb5964f7-baec-44a7-809b-36d1d2312216 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:21.154328 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-bb5964f7-baec-44a7-809b-36d1d2312216 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1756 microversion: 2.1 time: 0.171483 Jul 25 23:07:21.154896 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 226/454] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:20 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:07:21.245312 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-ebc416e8-1b01-4791-bc58-f885929503f3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:21.253671 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-ebc416e8-1b01-4791-bc58-f885929503f3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:21.255151 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-ebc416e8-1b01-4791-bc58-f885929503f3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:21.256290 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-ebc416e8-1b01-4791-bc58-f885929503f3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.158143 Jul 25 23:07:21.256846 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 229/455] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:21 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:07:22.175614 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-be4e141a-6195-41f8-9d1a-8b37c8f46d96 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:22.176291 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-be4e141a-6195-41f8-9d1a-8b37c8f46d96 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:22.182912 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-be4e141a-6195-41f8-9d1a-8b37c8f46d96 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:22.183352 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-be4e141a-6195-41f8-9d1a-8b37c8f46d96 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:22.184105 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-be4e141a-6195-41f8-9d1a-8b37c8f46d96 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:22.184529 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-be4e141a-6195-41f8-9d1a-8b37c8f46d96 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:22.279604 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-b72369d2-02b4-4758-ae30-c03e5a0d05f8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:22.280199 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-b72369d2-02b4-4758-ae30-c03e5a0d05f8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:22.286677 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b72369d2-02b4-4758-ae30-c03e5a0d05f8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:22.287118 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b72369d2-02b4-4758-ae30-c03e5a0d05f8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:22.287873 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b72369d2-02b4-4758-ae30-c03e5a0d05f8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:22.288299 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b72369d2-02b4-4758-ae30-c03e5a0d05f8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:22.350297 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-be4e141a-6195-41f8-9d1a-8b37c8f46d96 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:22.358686 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-be4e141a-6195-41f8-9d1a-8b37c8f46d96 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1756 microversion: 2.1 time: 0.186924 Jul 25 23:07:22.359259 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 227/456] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:22 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:07:22.434836 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-b72369d2-02b4-4758-ae30-c03e5a0d05f8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:22.443440 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-b72369d2-02b4-4758-ae30-c03e5a0d05f8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:22.445016 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-b72369d2-02b4-4758-ae30-c03e5a0d05f8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:22.446940 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-b72369d2-02b4-4758-ae30-c03e5a0d05f8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.171196 Jul 25 23:07:22.447502 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 230/457] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:22 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:07:23.381949 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-9aac9aef-9add-4d3b-8310-cea9b5d790f8 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:23.383197 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-9aac9aef-9add-4d3b-8310-cea9b5d790f8 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:23.390970 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9aac9aef-9add-4d3b-8310-cea9b5d790f8 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:23.391411 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9aac9aef-9add-4d3b-8310-cea9b5d790f8 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:23.392210 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9aac9aef-9add-4d3b-8310-cea9b5d790f8 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:23.392635 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9aac9aef-9add-4d3b-8310-cea9b5d790f8 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:23.396862 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:07:23.470312 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-6a9e9625-4463-4a35-9677-d033dd4873dc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:23.470915 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-6a9e9625-4463-4a35-9677-d033dd4873dc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:23.478146 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6a9e9625-4463-4a35-9677-d033dd4873dc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:23.478728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6a9e9625-4463-4a35-9677-d033dd4873dc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:23.479530 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6a9e9625-4463-4a35-9677-d033dd4873dc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:23.479963 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6a9e9625-4463-4a35-9677-d033dd4873dc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:23.571895 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9aac9aef-9add-4d3b-8310-cea9b5d790f8 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:23.580291 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-9aac9aef-9add-4d3b-8310-cea9b5d790f8 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1756 microversion: 2.1 time: 0.202178 Jul 25 23:07:23.580864 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 228/458] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:23 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1756 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:07:23.638054 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-6a9e9625-4463-4a35-9677-d033dd4873dc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:23.646624 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-6a9e9625-4463-4a35-9677-d033dd4873dc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:23.649574 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-6a9e9625-4463-4a35-9677-d033dd4873dc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:23.650845 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-6a9e9625-4463-4a35-9677-d033dd4873dc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.184553 Jul 25 23:07:23.651483 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 231/459] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:23 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:07:24.602977 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4d3c1a6b-7aa3-4a3f-8ee2-3b0bbdb75132 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:24.603945 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4d3c1a6b-7aa3-4a3f-8ee2-3b0bbdb75132 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:24.610626 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4d3c1a6b-7aa3-4a3f-8ee2-3b0bbdb75132 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:24.611065 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4d3c1a6b-7aa3-4a3f-8ee2-3b0bbdb75132 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:24.611841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4d3c1a6b-7aa3-4a3f-8ee2-3b0bbdb75132 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:24.612256 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4d3c1a6b-7aa3-4a3f-8ee2-3b0bbdb75132 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:24.674317 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-d0288539-32ab-417c-8c83-7279a654eff6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:24.674912 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-d0288539-32ab-417c-8c83-7279a654eff6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:24.681702 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d0288539-32ab-417c-8c83-7279a654eff6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:24.682371 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d0288539-32ab-417c-8c83-7279a654eff6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:24.683305 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d0288539-32ab-417c-8c83-7279a654eff6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:24.683734 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d0288539-32ab-417c-8c83-7279a654eff6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:24.815556 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4d3c1a6b-7aa3-4a3f-8ee2-3b0bbdb75132 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:24.824605 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4d3c1a6b-7aa3-4a3f-8ee2-3b0bbdb75132 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1756 microversion: 2.1 time: 0.226302 Jul 25 23:07:24.825214 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 229/460] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:24 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1756 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:07:24.862420 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-d0288539-32ab-417c-8c83-7279a654eff6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:24.874329 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-d0288539-32ab-417c-8c83-7279a654eff6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:24.874329 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-d0288539-32ab-417c-8c83-7279a654eff6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:24.874329 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-d0288539-32ab-417c-8c83-7279a654eff6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.203573 Jul 25 23:07:24.889414 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 232/461] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:24 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:07:25.846632 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-16140be4-0b59-4ab6-a633-6b453e93165b tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:25.847255 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-16140be4-0b59-4ab6-a633-6b453e93165b tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:25.854851 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-16140be4-0b59-4ab6-a633-6b453e93165b tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:25.855302 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-16140be4-0b59-4ab6-a633-6b453e93165b tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:25.856074 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-16140be4-0b59-4ab6-a633-6b453e93165b tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:25.856507 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-16140be4-0b59-4ab6-a633-6b453e93165b tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:25.900085 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-3476de7d-16cd-42eb-a113-2e96351e2f64 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:25.900689 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-3476de7d-16cd-42eb-a113-2e96351e2f64 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:25.907324 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3476de7d-16cd-42eb-a113-2e96351e2f64 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:25.907775 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3476de7d-16cd-42eb-a113-2e96351e2f64 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:25.908553 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3476de7d-16cd-42eb-a113-2e96351e2f64 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:25.908981 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3476de7d-16cd-42eb-a113-2e96351e2f64 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:26.073178 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-16140be4-0b59-4ab6-a633-6b453e93165b tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:26.081971 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-16140be4-0b59-4ab6-a633-6b453e93165b tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1756 microversion: 2.1 time: 0.239201 Jul 25 23:07:26.082555 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 230/462] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:25 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1756 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:07:26.110873 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-3476de7d-16cd-42eb-a113-2e96351e2f64 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:26.133994 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-3476de7d-16cd-42eb-a113-2e96351e2f64 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:26.135527 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-3476de7d-16cd-42eb-a113-2e96351e2f64 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:26.136753 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-3476de7d-16cd-42eb-a113-2e96351e2f64 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.240962 Jul 25 23:07:26.137305 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 233/463] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:25 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:07:27.103890 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-91a304ac-10f4-401f-9657-aece2680269a tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:27.104477 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-91a304ac-10f4-401f-9657-aece2680269a tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:27.111011 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-91a304ac-10f4-401f-9657-aece2680269a tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:27.111398 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-91a304ac-10f4-401f-9657-aece2680269a tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:27.112159 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-91a304ac-10f4-401f-9657-aece2680269a tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:27.112588 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-91a304ac-10f4-401f-9657-aece2680269a tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:27.159962 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-8fef4f48-53b6-475d-a760-b3c759451c8e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:27.160400 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-8fef4f48-53b6-475d-a760-b3c759451c8e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:27.168177 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8fef4f48-53b6-475d-a760-b3c759451c8e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:27.171537 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8fef4f48-53b6-475d-a760-b3c759451c8e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:27.172337 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8fef4f48-53b6-475d-a760-b3c759451c8e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:27.172858 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8fef4f48-53b6-475d-a760-b3c759451c8e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:27.313614 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-91a304ac-10f4-401f-9657-aece2680269a tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:27.323177 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-91a304ac-10f4-401f-9657-aece2680269a tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1756 microversion: 2.1 time: 0.223086 Jul 25 23:07:27.323860 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 231/464] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:27 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1756 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:07:27.356648 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-8fef4f48-53b6-475d-a760-b3c759451c8e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:27.365176 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-8fef4f48-53b6-475d-a760-b3c759451c8e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:27.366722 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-8fef4f48-53b6-475d-a760-b3c759451c8e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:27.367883 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-8fef4f48-53b6-475d-a760-b3c759451c8e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.211931 Jul 25 23:07:27.368431 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 234/465] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:27 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:07:28.345162 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e97b7865-ec2a-493a-8f29-7c3bc8a489cc tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:28.345964 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e97b7865-ec2a-493a-8f29-7c3bc8a489cc tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:28.352977 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e97b7865-ec2a-493a-8f29-7c3bc8a489cc tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:28.353456 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e97b7865-ec2a-493a-8f29-7c3bc8a489cc tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:28.354855 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e97b7865-ec2a-493a-8f29-7c3bc8a489cc tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:28.354855 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e97b7865-ec2a-493a-8f29-7c3bc8a489cc tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:28.391169 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-425241af-8f8f-4652-a09a-6e7b71db2ef1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:28.391779 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-425241af-8f8f-4652-a09a-6e7b71db2ef1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:28.398739 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-425241af-8f8f-4652-a09a-6e7b71db2ef1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:28.399626 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-425241af-8f8f-4652-a09a-6e7b71db2ef1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:28.400124 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-425241af-8f8f-4652-a09a-6e7b71db2ef1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:28.400557 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-425241af-8f8f-4652-a09a-6e7b71db2ef1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:28.558508 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e97b7865-ec2a-493a-8f29-7c3bc8a489cc tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:28.566932 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e97b7865-ec2a-493a-8f29-7c3bc8a489cc tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1756 microversion: 2.1 time: 0.225698 Jul 25 23:07:28.567515 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 232/466] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:28 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1756 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:07:28.583507 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-425241af-8f8f-4652-a09a-6e7b71db2ef1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:28.592872 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-425241af-8f8f-4652-a09a-6e7b71db2ef1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:28.594427 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-425241af-8f8f-4652-a09a-6e7b71db2ef1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:28.595576 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-425241af-8f8f-4652-a09a-6e7b71db2ef1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.208328 Jul 25 23:07:28.596160 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 235/467] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:28 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:07:29.588804 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b9dd008b-683e-4658-9969-0f6022890e3f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:29.589427 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b9dd008b-683e-4658-9969-0f6022890e3f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:29.596019 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b9dd008b-683e-4658-9969-0f6022890e3f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:29.596462 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b9dd008b-683e-4658-9969-0f6022890e3f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:29.597292 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b9dd008b-683e-4658-9969-0f6022890e3f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:29.597730 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b9dd008b-683e-4658-9969-0f6022890e3f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:29.619206 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-b530c1d2-3cc5-4a4e-b8ab-4dd9da8c6f5f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:29.619803 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-b530c1d2-3cc5-4a4e-b8ab-4dd9da8c6f5f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:29.626645 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b530c1d2-3cc5-4a4e-b8ab-4dd9da8c6f5f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:29.627090 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b530c1d2-3cc5-4a4e-b8ab-4dd9da8c6f5f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:29.627853 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b530c1d2-3cc5-4a4e-b8ab-4dd9da8c6f5f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:29.628285 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b530c1d2-3cc5-4a4e-b8ab-4dd9da8c6f5f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:29.801199 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b9dd008b-683e-4658-9969-0f6022890e3f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:29.810465 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b9dd008b-683e-4658-9969-0f6022890e3f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1756 microversion: 2.1 time: 0.226168 Jul 25 23:07:29.811041 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 233/468] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:29 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1756 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:07:30.048860 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-b530c1d2-3cc5-4a4e-b8ab-4dd9da8c6f5f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:30.058039 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-b530c1d2-3cc5-4a4e-b8ab-4dd9da8c6f5f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:30.059522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-b530c1d2-3cc5-4a4e-b8ab-4dd9da8c6f5f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:30.060660 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-b530c1d2-3cc5-4a4e-b8ab-4dd9da8c6f5f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.445513 Jul 25 23:07:30.061427 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 236/469] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:29 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:07:30.833082 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a008c106-f3b8-4a58-b059-b0c8afeeec23 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:30.833703 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a008c106-f3b8-4a58-b059-b0c8afeeec23 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:30.840930 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a008c106-f3b8-4a58-b059-b0c8afeeec23 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:30.841417 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a008c106-f3b8-4a58-b059-b0c8afeeec23 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:30.842189 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a008c106-f3b8-4a58-b059-b0c8afeeec23 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:30.842623 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a008c106-f3b8-4a58-b059-b0c8afeeec23 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:30.983428 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a008c106-f3b8-4a58-b059-b0c8afeeec23 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:30.991453 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a008c106-f3b8-4a58-b059-b0c8afeeec23 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1756 microversion: 2.1 time: 0.162210 Jul 25 23:07:30.992072 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 234/470] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:30 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:07:31.084503 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-5094e95a-1afc-40c1-a811-a92771a766f5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:31.085110 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-5094e95a-1afc-40c1-a811-a92771a766f5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:31.092269 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5094e95a-1afc-40c1-a811-a92771a766f5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:31.092714 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5094e95a-1afc-40c1-a811-a92771a766f5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:31.093493 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5094e95a-1afc-40c1-a811-a92771a766f5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:31.093920 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5094e95a-1afc-40c1-a811-a92771a766f5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:31.234482 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-5094e95a-1afc-40c1-a811-a92771a766f5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:31.244505 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-5094e95a-1afc-40c1-a811-a92771a766f5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:31.246146 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-5094e95a-1afc-40c1-a811-a92771a766f5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:31.247300 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-5094e95a-1afc-40c1-a811-a92771a766f5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.166859 Jul 25 23:07:31.247870 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 237/471] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:31 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:07:32.013461 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-3120d576-85c2-497c-a7d9-3ffc1d9e22d6 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:32.014238 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-3120d576-85c2-497c-a7d9-3ffc1d9e22d6 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:32.016843 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=50 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:07:32.022529 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3120d576-85c2-497c-a7d9-3ffc1d9e22d6 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:32.023577 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3120d576-85c2-497c-a7d9-3ffc1d9e22d6 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:32.024953 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3120d576-85c2-497c-a7d9-3ffc1d9e22d6 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:32.025464 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3120d576-85c2-497c-a7d9-3ffc1d9e22d6 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:32.172041 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-3120d576-85c2-497c-a7d9-3ffc1d9e22d6 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:32.180405 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-3120d576-85c2-497c-a7d9-3ffc1d9e22d6 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1756 microversion: 2.1 time: 0.171742 Jul 25 23:07:32.180969 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 235/472] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:32 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:07:32.272070 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-b5e2f0e3-d781-4343-b40e-8a7bf011bde8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:32.272693 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-b5e2f0e3-d781-4343-b40e-8a7bf011bde8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:32.280738 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b5e2f0e3-d781-4343-b40e-8a7bf011bde8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:32.281214 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b5e2f0e3-d781-4343-b40e-8a7bf011bde8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:32.281966 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b5e2f0e3-d781-4343-b40e-8a7bf011bde8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:32.282391 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b5e2f0e3-d781-4343-b40e-8a7bf011bde8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:32.286508 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=100 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:07:32.418446 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-b5e2f0e3-d781-4343-b40e-8a7bf011bde8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:32.429065 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-b5e2f0e3-d781-4343-b40e-8a7bf011bde8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:32.430707 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-b5e2f0e3-d781-4343-b40e-8a7bf011bde8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:32.431894 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-b5e2f0e3-d781-4343-b40e-8a7bf011bde8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.164058 Jul 25 23:07:32.432624 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 238/473] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:32 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:07:33.202207 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b515d76d-2db0-4c14-b7d1-1bb006d68112 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:33.202822 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b515d76d-2db0-4c14-b7d1-1bb006d68112 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:33.209487 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b515d76d-2db0-4c14-b7d1-1bb006d68112 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:33.209944 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b515d76d-2db0-4c14-b7d1-1bb006d68112 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:33.210831 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b515d76d-2db0-4c14-b7d1-1bb006d68112 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:33.211523 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b515d76d-2db0-4c14-b7d1-1bb006d68112 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:33.362086 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b515d76d-2db0-4c14-b7d1-1bb006d68112 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:33.371029 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b515d76d-2db0-4c14-b7d1-1bb006d68112 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1756 microversion: 2.1 time: 0.172902 Jul 25 23:07:33.371596 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 236/474] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:33 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:07:33.464705 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-66b8d76a-123b-485e-9cbf-3ae93439f4c0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:33.465284 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-66b8d76a-123b-485e-9cbf-3ae93439f4c0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:33.472251 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-66b8d76a-123b-485e-9cbf-3ae93439f4c0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:33.472693 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-66b8d76a-123b-485e-9cbf-3ae93439f4c0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:33.473533 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-66b8d76a-123b-485e-9cbf-3ae93439f4c0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:33.473964 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-66b8d76a-123b-485e-9cbf-3ae93439f4c0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:33.610202 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-66b8d76a-123b-485e-9cbf-3ae93439f4c0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:33.619328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-66b8d76a-123b-485e-9cbf-3ae93439f4c0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:33.620828 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-66b8d76a-123b-485e-9cbf-3ae93439f4c0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:33.622002 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-66b8d76a-123b-485e-9cbf-3ae93439f4c0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.162072 Jul 25 23:07:33.622584 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 239/475] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:33 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:07:34.391860 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5cb26938-5e23-4c2c-957c-83232ed64e55 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:34.392483 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-5cb26938-5e23-4c2c-957c-83232ed64e55 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:34.399948 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5cb26938-5e23-4c2c-957c-83232ed64e55 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:34.400437 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5cb26938-5e23-4c2c-957c-83232ed64e55 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:34.401167 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5cb26938-5e23-4c2c-957c-83232ed64e55 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:34.401603 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5cb26938-5e23-4c2c-957c-83232ed64e55 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:34.547027 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-5cb26938-5e23-4c2c-957c-83232ed64e55 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:34.555658 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-5cb26938-5e23-4c2c-957c-83232ed64e55 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1756 microversion: 2.1 time: 0.167651 Jul 25 23:07:34.558114 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 237/476] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:34 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:07:34.646625 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-a43e1cb3-1429-4591-a70b-1432b71261b4 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:34.648052 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-a43e1cb3-1429-4591-a70b-1432b71261b4 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:34.653060 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_api:SELECT=56 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:07:34.656886 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a43e1cb3-1429-4591-a70b-1432b71261b4 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:34.657712 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a43e1cb3-1429-4591-a70b-1432b71261b4 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:34.661398 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a43e1cb3-1429-4591-a70b-1432b71261b4 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:34.661398 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a43e1cb3-1429-4591-a70b-1432b71261b4 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:34.804292 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-a43e1cb3-1429-4591-a70b-1432b71261b4 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:34.814440 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-a43e1cb3-1429-4591-a70b-1432b71261b4 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:34.815939 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-a43e1cb3-1429-4591-a70b-1432b71261b4 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:34.817219 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-a43e1cb3-1429-4591-a70b-1432b71261b4 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.175365 Jul 25 23:07:34.817779 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 240/477] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:34 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:07:35.577561 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-596beeb0-0c5a-452f-8588-3ad5815903e5 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:35.578163 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-596beeb0-0c5a-452f-8588-3ad5815903e5 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:35.586269 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-596beeb0-0c5a-452f-8588-3ad5815903e5 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:35.586809 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-596beeb0-0c5a-452f-8588-3ad5815903e5 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:35.587698 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-596beeb0-0c5a-452f-8588-3ad5815903e5 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:35.588149 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-596beeb0-0c5a-452f-8588-3ad5815903e5 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:35.747426 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-596beeb0-0c5a-452f-8588-3ad5815903e5 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:35.755940 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-596beeb0-0c5a-452f-8588-3ad5815903e5 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1759 microversion: 2.1 time: 0.182575 Jul 25 23:07:35.756492 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 238/478] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:35 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1759 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:07:35.841546 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-8a89aa1c-ba5c-4280-abb6-a3a9938c1f3b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:35.842127 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-8a89aa1c-ba5c-4280-abb6-a3a9938c1f3b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:35.848719 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8a89aa1c-ba5c-4280-abb6-a3a9938c1f3b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:35.849258 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8a89aa1c-ba5c-4280-abb6-a3a9938c1f3b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:35.849951 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8a89aa1c-ba5c-4280-abb6-a3a9938c1f3b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:35.850388 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8a89aa1c-ba5c-4280-abb6-a3a9938c1f3b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:35.992140 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-8a89aa1c-ba5c-4280-abb6-a3a9938c1f3b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:36.001200 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-8a89aa1c-ba5c-4280-abb6-a3a9938c1f3b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:36.002679 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-8a89aa1c-ba5c-4280-abb6-a3a9938c1f3b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:36.003829 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-8a89aa1c-ba5c-4280-abb6-a3a9938c1f3b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.166510 Jul 25 23:07:36.004650 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 241/479] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:35 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:07:37.028747 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-fce94e4b-fa2a-49e2-82f1-dfc4c9cb2465 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:37.029571 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-fce94e4b-fa2a-49e2-82f1-dfc4c9cb2465 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:37.036160 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fce94e4b-fa2a-49e2-82f1-dfc4c9cb2465 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:37.036597 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fce94e4b-fa2a-49e2-82f1-dfc4c9cb2465 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:37.037382 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fce94e4b-fa2a-49e2-82f1-dfc4c9cb2465 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:37.037811 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fce94e4b-fa2a-49e2-82f1-dfc4c9cb2465 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:37.167150 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-fce94e4b-fa2a-49e2-82f1-dfc4c9cb2465 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:37.175820 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-fce94e4b-fa2a-49e2-82f1-dfc4c9cb2465 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:37.177326 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-fce94e4b-fa2a-49e2-82f1-dfc4c9cb2465 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:37.178456 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-fce94e4b-fa2a-49e2-82f1-dfc4c9cb2465 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.154356 Jul 25 23:07:37.179013 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 239/480] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:37 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:07:38.202754 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-10ec3c10-cf00-48d6-877d-91a373a999f2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:38.203354 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-10ec3c10-cf00-48d6-877d-91a373a999f2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:38.209828 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-10ec3c10-cf00-48d6-877d-91a373a999f2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:38.210273 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-10ec3c10-cf00-48d6-877d-91a373a999f2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:38.211028 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-10ec3c10-cf00-48d6-877d-91a373a999f2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:38.211458 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-10ec3c10-cf00-48d6-877d-91a373a999f2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:38.346895 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-10ec3c10-cf00-48d6-877d-91a373a999f2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:38.355846 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-10ec3c10-cf00-48d6-877d-91a373a999f2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:38.357388 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-10ec3c10-cf00-48d6-877d-91a373a999f2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:38.358532 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-10ec3c10-cf00-48d6-877d-91a373a999f2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.160489 Jul 25 23:07:38.359085 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 242/481] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:38 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:07:39.383628 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-2288d619-fd15-4c21-96d5-bb4d22f0d8c7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:39.384296 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-2288d619-fd15-4c21-96d5-bb4d22f0d8c7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:39.392062 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2288d619-fd15-4c21-96d5-bb4d22f0d8c7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:39.392269 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2288d619-fd15-4c21-96d5-bb4d22f0d8c7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:39.393042 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2288d619-fd15-4c21-96d5-bb4d22f0d8c7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:39.393505 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2288d619-fd15-4c21-96d5-bb4d22f0d8c7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:39.537377 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-2288d619-fd15-4c21-96d5-bb4d22f0d8c7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:39.547158 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-2288d619-fd15-4c21-96d5-bb4d22f0d8c7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:39.548618 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-2288d619-fd15-4c21-96d5-bb4d22f0d8c7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:39.549806 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-2288d619-fd15-4c21-96d5-bb4d22f0d8c7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.170192 Jul 25 23:07:39.550365 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 240/482] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:39 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:07:40.486470 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-713b7811-bae1-4428-bbc6-8a2460803402 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:40.488362 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-713b7811-bae1-4428-bbc6-8a2460803402 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:40.493726 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-713b7811-bae1-4428-bbc6-8a2460803402 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:40.494156 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-713b7811-bae1-4428-bbc6-8a2460803402 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:40.494907 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-713b7811-bae1-4428-bbc6-8a2460803402 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:40.495517 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-713b7811-bae1-4428-bbc6-8a2460803402 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:40.574806 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-7a4a84e1-2013-4bd4-a51e-cd2bfce62de7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:40.575402 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-7a4a84e1-2013-4bd4-a51e-cd2bfce62de7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:40.585276 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7a4a84e1-2013-4bd4-a51e-cd2bfce62de7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:40.585276 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7a4a84e1-2013-4bd4-a51e-cd2bfce62de7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:40.585276 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7a4a84e1-2013-4bd4-a51e-cd2bfce62de7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:40.585276 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7a4a84e1-2013-4bd4-a51e-cd2bfce62de7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:40.630524 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.objects.instance [None req-713b7811-bae1-4428-bbc6-8a2460803402 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lazy-loading 'services' on Instance uuid 6efbf144-c03b-44d4-ad8f-0382560ed59d {{(pid=118409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 23:07:40.730764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7a4a84e1-2013-4bd4-a51e-cd2bfce62de7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:40.739818 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7a4a84e1-2013-4bd4-a51e-cd2bfce62de7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:40.741638 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7a4a84e1-2013-4bd4-a51e-cd2bfce62de7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:40.742838 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-7a4a84e1-2013-4bd4-a51e-cd2bfce62de7 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.172561 Jul 25 23:07:40.743403 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 241/483] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:40 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:07:40.887111 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-713b7811-bae1-4428-bbc6-8a2460803402 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d/os-volume_attachments/ae9b41da-1105-48c0-a1e0-3e78f73ca1ae" status: 202 len: 0 microversion: 2.1 time: 0.403848 Jul 25 23:07:40.887712 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 243/484] 10.222.0.55 () {58 vars in 1416 bytes} [Mon Jul 25 23:07:40 2022] DELETE /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d/os-volume_attachments/ae9b41da-1105-48c0-a1e0-3e78f73ca1ae => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 23:07:41.766189 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e68b9a04-95b0-4e63-84db-c4f86d3ab673 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:41.766777 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e68b9a04-95b0-4e63-84db-c4f86d3ab673 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:41.773385 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e68b9a04-95b0-4e63-84db-c4f86d3ab673 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:41.776983 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e68b9a04-95b0-4e63-84db-c4f86d3ab673 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:41.776983 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e68b9a04-95b0-4e63-84db-c4f86d3ab673 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:41.776983 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e68b9a04-95b0-4e63-84db-c4f86d3ab673 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:41.934955 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e68b9a04-95b0-4e63-84db-c4f86d3ab673 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:41.943686 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e68b9a04-95b0-4e63-84db-c4f86d3ab673 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:41.945199 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e68b9a04-95b0-4e63-84db-c4f86d3ab673 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:41.946361 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e68b9a04-95b0-4e63-84db-c4f86d3ab673 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.184238 Jul 25 23:07:41.946924 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 242/485] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:41 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:07:42.971231 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-ba9c20e4-26d0-44d8-bd8c-9045ded7e577 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:42.972023 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-ba9c20e4-26d0-44d8-bd8c-9045ded7e577 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:42.979096 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ba9c20e4-26d0-44d8-bd8c-9045ded7e577 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:42.979541 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ba9c20e4-26d0-44d8-bd8c-9045ded7e577 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:42.979775 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-ea981555-3d59-4a3a-9a91-8937a7ee3971 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d959db9-b729-4321-b55e-5535532598a7"}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:07:42.980309 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ba9c20e4-26d0-44d8-bd8c-9045ded7e577 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:42.981341 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ba9c20e4-26d0-44d8-bd8c-9045ded7e577 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:42.983398 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-ea981555-3d59-4a3a-9a91-8937a7ee3971 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:42.990061 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ea981555-3d59-4a3a-9a91-8937a7ee3971 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:42.990497 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ea981555-3d59-4a3a-9a91-8937a7ee3971 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:42.991260 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ea981555-3d59-4a3a-9a91-8937a7ee3971 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:42.991686 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ea981555-3d59-4a3a-9a91-8937a7ee3971 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:43.124457 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-ba9c20e4-26d0-44d8-bd8c-9045ded7e577 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:43.132925 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-ba9c20e4-26d0-44d8-bd8c-9045ded7e577 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:43.134451 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-ba9c20e4-26d0-44d8-bd8c-9045ded7e577 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:43.135592 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-ba9c20e4-26d0-44d8-bd8c-9045ded7e577 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.169192 Jul 25 23:07:43.136177 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 244/486] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:42 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:07:44.160269 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-32aeca27-9f0b-4468-b852-a38702070296 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:44.160945 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-32aeca27-9f0b-4468-b852-a38702070296 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:44.167495 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-32aeca27-9f0b-4468-b852-a38702070296 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:44.167947 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-32aeca27-9f0b-4468-b852-a38702070296 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:44.168709 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-32aeca27-9f0b-4468-b852-a38702070296 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:44.169219 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-32aeca27-9f0b-4468-b852-a38702070296 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:44.314655 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-32aeca27-9f0b-4468-b852-a38702070296 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:44.327190 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-32aeca27-9f0b-4468-b852-a38702070296 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:44.327629 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-32aeca27-9f0b-4468-b852-a38702070296 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:44.328844 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-32aeca27-9f0b-4468-b852-a38702070296 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1809 microversion: 2.20 time: 0.172871 Jul 25 23:07:44.329483 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 245/487] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:44 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:07:44.816220 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:07:45.012287 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-ea981555-3d59-4a3a-9a91-8937a7ee3971 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "POST /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.035906 Jul 25 23:07:45.013104 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 243/488] 10.222.0.55 () {60 vars in 1323 bytes} [Mon Jul 25 23:07:42 2022] POST /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8/os-volume_attachments => generated 194 bytes in 2038 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 23:07:45.289255 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-cc34b5fd-3714-4544-8920-986b7ba7a36b tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:07:45.304292 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cc34b5fd-3714-4544-8920-986b7ba7a36b tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:45.304292 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cc34b5fd-3714-4544-8920-986b7ba7a36b tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:45.356924 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-94249225-0b81-4d48-9b1e-1af8fe06fad5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:45.357664 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-94249225-0b81-4d48-9b1e-1af8fe06fad5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:45.368807 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-94249225-0b81-4d48-9b1e-1af8fe06fad5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:45.373384 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-94249225-0b81-4d48-9b1e-1af8fe06fad5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:45.374488 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-94249225-0b81-4d48-9b1e-1af8fe06fad5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:45.375064 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-94249225-0b81-4d48-9b1e-1af8fe06fad5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:45.391007 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-cc34b5fd-3714-4544-8920-986b7ba7a36b tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Going to try to stop instance {{(pid=118409) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 25 23:07:45.520216 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-94249225-0b81-4d48-9b1e-1af8fe06fad5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:45.529479 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-94249225-0b81-4d48-9b1e-1af8fe06fad5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:45.542252 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-94249225-0b81-4d48-9b1e-1af8fe06fad5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:45.542252 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-94249225-0b81-4d48-9b1e-1af8fe06fad5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1796 microversion: 2.20 time: 0.182324 Jul 25 23:07:45.542252 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 244/489] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:07:45 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1796 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:07:45.600718 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-cc34b5fd-3714-4544-8920-986b7ba7a36b tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "POST /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d/action" status: 202 len: 0 microversion: 2.1 time: 0.315167 Jul 25 23:07:45.601357 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 246/490] 10.222.0.55 () {60 vars in 1278 bytes} [Mon Jul 25 23:07:45 2022] POST /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 23:07:45.610006 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-00b90754-3a18-4541-932b-46fdc03871a0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:45.610712 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-00b90754-3a18-4541-932b-46fdc03871a0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:45.616897 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-00b90754-3a18-4541-932b-46fdc03871a0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:45.617453 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-00b90754-3a18-4541-932b-46fdc03871a0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:45.618228 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-00b90754-3a18-4541-932b-46fdc03871a0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:45.618666 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-00b90754-3a18-4541-932b-46fdc03871a0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:45.751709 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-00b90754-3a18-4541-932b-46fdc03871a0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:45.759277 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-00b90754-3a18-4541-932b-46fdc03871a0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1678 microversion: 2.1 time: 0.153347 Jul 25 23:07:45.761399 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 245/491] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:45 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:07:46.783186 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-02f67646-929e-4fd4-b008-0cef88295e9f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:46.783835 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-02f67646-929e-4fd4-b008-0cef88295e9f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:46.790092 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-02f67646-929e-4fd4-b008-0cef88295e9f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:46.790532 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-02f67646-929e-4fd4-b008-0cef88295e9f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:46.791287 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-02f67646-929e-4fd4-b008-0cef88295e9f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:46.791711 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-02f67646-929e-4fd4-b008-0cef88295e9f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:46.928629 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-02f67646-929e-4fd4-b008-0cef88295e9f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:46.937658 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-02f67646-929e-4fd4-b008-0cef88295e9f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1678 microversion: 2.1 time: 0.160233 Jul 25 23:07:46.938221 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 247/492] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:46 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:07:47.962954 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-86a2235d-3999-4371-b6f0-d9ffa69801cf tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:47.963547 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-86a2235d-3999-4371-b6f0-d9ffa69801cf tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:47.970705 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-86a2235d-3999-4371-b6f0-d9ffa69801cf tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:47.971148 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-86a2235d-3999-4371-b6f0-d9ffa69801cf tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:47.971910 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-86a2235d-3999-4371-b6f0-d9ffa69801cf tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:47.972344 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-86a2235d-3999-4371-b6f0-d9ffa69801cf tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:48.102982 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-86a2235d-3999-4371-b6f0-d9ffa69801cf tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:48.111074 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-86a2235d-3999-4371-b6f0-d9ffa69801cf tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1678 microversion: 2.1 time: 0.151899 Jul 25 23:07:48.111580 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 246/493] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:47 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:07:49.132553 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-5ed9cdea-e46d-4841-a00b-ea792fe9f0be tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:49.133184 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-5ed9cdea-e46d-4841-a00b-ea792fe9f0be tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:49.140233 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5ed9cdea-e46d-4841-a00b-ea792fe9f0be tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:49.140669 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5ed9cdea-e46d-4841-a00b-ea792fe9f0be tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:49.141458 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5ed9cdea-e46d-4841-a00b-ea792fe9f0be tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:49.141883 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5ed9cdea-e46d-4841-a00b-ea792fe9f0be tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:49.272201 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-5ed9cdea-e46d-4841-a00b-ea792fe9f0be tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:49.281030 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-5ed9cdea-e46d-4841-a00b-ea792fe9f0be tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1678 microversion: 2.1 time: 0.152301 Jul 25 23:07:49.281625 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 248/494] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:49 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:07:50.303260 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-9e2baa0d-06c5-4881-aded-e0b7a9b9b7ed tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:50.303864 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-9e2baa0d-06c5-4881-aded-e0b7a9b9b7ed tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:50.311532 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9e2baa0d-06c5-4881-aded-e0b7a9b9b7ed tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:50.311980 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9e2baa0d-06c5-4881-aded-e0b7a9b9b7ed tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:50.312783 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9e2baa0d-06c5-4881-aded-e0b7a9b9b7ed tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:50.313239 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9e2baa0d-06c5-4881-aded-e0b7a9b9b7ed tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:50.458087 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9e2baa0d-06c5-4881-aded-e0b7a9b9b7ed tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:50.465821 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-9e2baa0d-06c5-4881-aded-e0b7a9b9b7ed tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1678 microversion: 2.1 time: 0.166475 Jul 25 23:07:50.466407 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 247/495] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:50 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:07:51.486859 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-216cfd83-b9c5-4dbb-8474-4997755c986f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:51.487902 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-216cfd83-b9c5-4dbb-8474-4997755c986f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:51.494378 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-216cfd83-b9c5-4dbb-8474-4997755c986f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:51.494819 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-216cfd83-b9c5-4dbb-8474-4997755c986f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:51.495571 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-216cfd83-b9c5-4dbb-8474-4997755c986f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:51.495990 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-216cfd83-b9c5-4dbb-8474-4997755c986f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:51.632780 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-216cfd83-b9c5-4dbb-8474-4997755c986f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:51.640316 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-216cfd83-b9c5-4dbb-8474-4997755c986f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1678 microversion: 2.1 time: 0.157283 Jul 25 23:07:51.640876 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 249/496] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:51 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:07:52.663504 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d22c9791-0559-4de4-a330-4d9874e0a64e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:52.664007 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-d22c9791-0559-4de4-a330-4d9874e0a64e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:52.672024 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d22c9791-0559-4de4-a330-4d9874e0a64e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:52.672466 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d22c9791-0559-4de4-a330-4d9874e0a64e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:52.673423 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d22c9791-0559-4de4-a330-4d9874e0a64e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:52.673859 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d22c9791-0559-4de4-a330-4d9874e0a64e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:52.809846 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-d22c9791-0559-4de4-a330-4d9874e0a64e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:52.818508 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-d22c9791-0559-4de4-a330-4d9874e0a64e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1678 microversion: 2.1 time: 0.159301 Jul 25 23:07:52.819069 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 248/497] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:52 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:07:53.839879 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-43811bd7-63f7-4d3e-980c-f784fac834cc tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:53.840458 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-43811bd7-63f7-4d3e-980c-f784fac834cc tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:53.847958 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-43811bd7-63f7-4d3e-980c-f784fac834cc tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:53.848397 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-43811bd7-63f7-4d3e-980c-f784fac834cc tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:53.849191 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-43811bd7-63f7-4d3e-980c-f784fac834cc tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:53.849620 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-43811bd7-63f7-4d3e-980c-f784fac834cc tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:53.986694 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-43811bd7-63f7-4d3e-980c-f784fac834cc tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:53.994160 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-43811bd7-63f7-4d3e-980c-f784fac834cc tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1678 microversion: 2.1 time: 0.158225 Jul 25 23:07:53.994748 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 250/498] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:53 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:07:55.016157 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5d0ae2d9-be47-4370-8771-6ebc7b46673b tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:55.016768 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-5d0ae2d9-be47-4370-8771-6ebc7b46673b tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:55.023364 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5d0ae2d9-be47-4370-8771-6ebc7b46673b tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:55.024066 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5d0ae2d9-be47-4370-8771-6ebc7b46673b tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:55.024857 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5d0ae2d9-be47-4370-8771-6ebc7b46673b tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:55.025334 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5d0ae2d9-be47-4370-8771-6ebc7b46673b tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:55.155770 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-5d0ae2d9-be47-4370-8771-6ebc7b46673b tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:55.163307 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-5d0ae2d9-be47-4370-8771-6ebc7b46673b tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1678 microversion: 2.1 time: 0.151743 Jul 25 23:07:55.163896 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 249/499] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:55 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:07:56.185487 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-c06187a8-3a28-4768-a843-60be0b7229e5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:56.186350 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-c06187a8-3a28-4768-a843-60be0b7229e5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:56.194653 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c06187a8-3a28-4768-a843-60be0b7229e5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:56.195197 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c06187a8-3a28-4768-a843-60be0b7229e5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:56.196172 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c06187a8-3a28-4768-a843-60be0b7229e5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:56.196615 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c06187a8-3a28-4768-a843-60be0b7229e5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:56.336488 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-c06187a8-3a28-4768-a843-60be0b7229e5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:56.346308 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-c06187a8-3a28-4768-a843-60be0b7229e5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1678 microversion: 2.1 time: 0.165421 Jul 25 23:07:56.346913 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 251/500] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:56 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:07:56.992382 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c3e99a11-9ec5-4ea5-b971-8e9250c69e28 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:07:56.994712 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c3e99a11-9ec5-4ea5-b971-8e9250c69e28 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:57.001949 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c3e99a11-9ec5-4ea5-b971-8e9250c69e28 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:57.002398 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c3e99a11-9ec5-4ea5-b971-8e9250c69e28 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:57.003167 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c3e99a11-9ec5-4ea5-b971-8e9250c69e28 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:57.003597 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c3e99a11-9ec5-4ea5-b971-8e9250c69e28 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:57.026912 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.objects.instance [None req-c3e99a11-9ec5-4ea5-b971-8e9250c69e28 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lazy-loading 'flavor' on Instance uuid 6b265736-7f3b-4414-a694-38120987bad8 {{(pid=118410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 23:07:57.367830 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-c9bdf129-814d-4b0c-ada8-f1a55ed6d8c5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:57.368429 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-c9bdf129-814d-4b0c-ada8-f1a55ed6d8c5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:57.374630 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c9bdf129-814d-4b0c-ada8-f1a55ed6d8c5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:57.375075 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c9bdf129-814d-4b0c-ada8-f1a55ed6d8c5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:57.375860 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c9bdf129-814d-4b0c-ada8-f1a55ed6d8c5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:57.376294 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c9bdf129-814d-4b0c-ada8-f1a55ed6d8c5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:57.450416 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c3e99a11-9ec5-4ea5-b971-8e9250c69e28 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "POST /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8/action" status: 200 len: 32 microversion: 2.1 time: 0.461888 Jul 25 23:07:57.451219 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 250/501] 10.222.0.55 () {60 vars in 1278 bytes} [Mon Jul 25 23:07:56 2022] POST /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8/action => generated 32 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 23:07:57.462244 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-ecbfacbc-4cbe-433c-b4c7-654962606357 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:57.462930 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-ecbfacbc-4cbe-433c-b4c7-654962606357 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:57.470465 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ecbfacbc-4cbe-433c-b4c7-654962606357 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:57.471065 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ecbfacbc-4cbe-433c-b4c7-654962606357 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:57.472587 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ecbfacbc-4cbe-433c-b4c7-654962606357 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:57.472587 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ecbfacbc-4cbe-433c-b4c7-654962606357 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:57.513147 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-c9bdf129-814d-4b0c-ada8-f1a55ed6d8c5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:57.520879 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-c9bdf129-814d-4b0c-ada8-f1a55ed6d8c5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1678 microversion: 2.1 time: 0.156882 Jul 25 23:07:57.521507 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 252/502] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:57 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:07:57.590953 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-93b21f9d-f5f8-46ed-8522-c45697007e06 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:57.591448 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-93b21f9d-f5f8-46ed-8522-c45697007e06 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:57.598744 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-93b21f9d-f5f8-46ed-8522-c45697007e06 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:57.599189 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-93b21f9d-f5f8-46ed-8522-c45697007e06 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:57.599965 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-93b21f9d-f5f8-46ed-8522-c45697007e06 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:57.600397 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-93b21f9d-f5f8-46ed-8522-c45697007e06 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:57.604719 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:07:57.650396 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ecbfacbc-4cbe-433c-b4c7-654962606357 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:57.658486 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-ecbfacbc-4cbe-433c-b4c7-654962606357 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1733 microversion: 2.1 time: 0.199391 Jul 25 23:07:57.659735 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 251/503] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:57 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1733 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:07:57.690167 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.objects.instance [None req-93b21f9d-f5f8-46ed-8522-c45697007e06 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lazy-loading 'services' on Instance uuid fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5 {{(pid=118409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 23:07:57.886456 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-93b21f9d-f5f8-46ed-8522-c45697007e06 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "DELETE /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5/os-volume_attachments/506ad727-ee07-4786-a41a-2887091cb03e" status: 202 len: 0 microversion: 2.1 time: 0.299268 Jul 25 23:07:57.887096 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 253/504] 10.222.0.55 () {58 vars in 1416 bytes} [Mon Jul 25 23:07:57 2022] DELETE /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5/os-volume_attachments/506ad727-ee07-4786-a41a-2887091cb03e => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 23:07:58.543285 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b5935854-df9c-4ef5-be25-dcf964e40352 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:58.543813 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b5935854-df9c-4ef5-be25-dcf964e40352 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:58.552365 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b5935854-df9c-4ef5-be25-dcf964e40352 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:58.552810 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b5935854-df9c-4ef5-be25-dcf964e40352 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:58.553628 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b5935854-df9c-4ef5-be25-dcf964e40352 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:58.554059 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b5935854-df9c-4ef5-be25-dcf964e40352 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:58.682354 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-80c5f1dc-9a50-4820-ad81-67679f5c8d52 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:58.683167 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-80c5f1dc-9a50-4820-ad81-67679f5c8d52 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:58.690919 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-80c5f1dc-9a50-4820-ad81-67679f5c8d52 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:58.691360 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-80c5f1dc-9a50-4820-ad81-67679f5c8d52 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:58.692200 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-80c5f1dc-9a50-4820-ad81-67679f5c8d52 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:58.692635 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-80c5f1dc-9a50-4820-ad81-67679f5c8d52 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:58.696612 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b5935854-df9c-4ef5-be25-dcf964e40352 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:58.705210 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b5935854-df9c-4ef5-be25-dcf964e40352 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1678 microversion: 2.1 time: 0.165236 Jul 25 23:07:58.705821 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 252/505] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:58 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:07:58.832004 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-80c5f1dc-9a50-4820-ad81-67679f5c8d52 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:58.840617 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-80c5f1dc-9a50-4820-ad81-67679f5c8d52 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1733 microversion: 2.1 time: 0.162867 Jul 25 23:07:58.841228 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 254/506] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:58 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:07:59.727548 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6d140f0b-aba7-40aa-9912-92149cc8b99c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:59.728111 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6d140f0b-aba7-40aa-9912-92149cc8b99c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:59.734569 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6d140f0b-aba7-40aa-9912-92149cc8b99c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:59.735017 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6d140f0b-aba7-40aa-9912-92149cc8b99c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:59.736385 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6d140f0b-aba7-40aa-9912-92149cc8b99c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:59.736989 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6d140f0b-aba7-40aa-9912-92149cc8b99c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:59.862257 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-4b1f310c-3baf-48e9-a140-dee6529b9da4 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:07:59.864021 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-4b1f310c-3baf-48e9-a140-dee6529b9da4 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:07:59.870212 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4b1f310c-3baf-48e9-a140-dee6529b9da4 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:59.870657 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4b1f310c-3baf-48e9-a140-dee6529b9da4 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:59.871433 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4b1f310c-3baf-48e9-a140-dee6529b9da4 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:07:59.871864 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4b1f310c-3baf-48e9-a140-dee6529b9da4 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:07:59.879525 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6d140f0b-aba7-40aa-9912-92149cc8b99c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:07:59.888940 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6d140f0b-aba7-40aa-9912-92149cc8b99c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1678 microversion: 2.1 time: 0.165276 Jul 25 23:07:59.889727 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 253/507] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:59 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:00.005491 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-4b1f310c-3baf-48e9-a140-dee6529b9da4 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:00.013518 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-4b1f310c-3baf-48e9-a140-dee6529b9da4 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1733 microversion: 2.1 time: 0.155180 Jul 25 23:08:00.014082 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 255/508] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:07:59 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:00.075294 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a6655dc5-088f-4ef2-85db-0950c07d4bd4 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:00.075782 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a6655dc5-088f-4ef2-85db-0950c07d4bd4 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:00.082538 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a6655dc5-088f-4ef2-85db-0950c07d4bd4 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:00.082982 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a6655dc5-088f-4ef2-85db-0950c07d4bd4 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:00.083781 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a6655dc5-088f-4ef2-85db-0950c07d4bd4 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:00.084215 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a6655dc5-088f-4ef2-85db-0950c07d4bd4 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:00.113491 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a6655dc5-088f-4ef2-85db-0950c07d4bd4 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5] Going to try to terminate instance {{(pid=118410) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 23:08:00.452702 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a6655dc5-088f-4ef2-85db-0950c07d4bd4 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "DELETE /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5" status: 204 len: 0 microversion: 2.1 time: 0.380817 Jul 25 23:08:00.453542 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 254/509] 10.222.0.55 () {58 vars in 1239 bytes} [Mon Jul 25 23:08:00 2022] DELETE /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 23:08:00.461810 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-5bef1517-9a4c-4b78-8682-9c91c110f392 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:00.462297 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-5bef1517-9a4c-4b78-8682-9c91c110f392 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:00.468338 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5bef1517-9a4c-4b78-8682-9c91c110f392 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:00.468780 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5bef1517-9a4c-4b78-8682-9c91c110f392 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:00.469563 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5bef1517-9a4c-4b78-8682-9c91c110f392 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:00.469997 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5bef1517-9a4c-4b78-8682-9c91c110f392 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:00.608666 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-5bef1517-9a4c-4b78-8682-9c91c110f392 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:00.617410 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-5bef1517-9a4c-4b78-8682-9c91c110f392 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5" status: 200 len: 1514 microversion: 2.1 time: 0.159636 Jul 25 23:08:00.617978 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 256/510] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:00 2022] GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:00.912254 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f5271505-ca4b-4abf-a04f-31d919e39ff6 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:00.912945 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f5271505-ca4b-4abf-a04f-31d919e39ff6 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:00.919515 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f5271505-ca4b-4abf-a04f-31d919e39ff6 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:00.919958 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f5271505-ca4b-4abf-a04f-31d919e39ff6 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:00.920716 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f5271505-ca4b-4abf-a04f-31d919e39ff6 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:00.921166 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f5271505-ca4b-4abf-a04f-31d919e39ff6 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:01.036859 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-02eb8b1d-fd0d-4e66-84d0-5b91b21becb5 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:01.037489 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-02eb8b1d-fd0d-4e66-84d0-5b91b21becb5 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:01.044221 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-02eb8b1d-fd0d-4e66-84d0-5b91b21becb5 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:01.044662 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-02eb8b1d-fd0d-4e66-84d0-5b91b21becb5 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:01.045447 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-02eb8b1d-fd0d-4e66-84d0-5b91b21becb5 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:01.045877 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-02eb8b1d-fd0d-4e66-84d0-5b91b21becb5 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:01.050992 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f5271505-ca4b-4abf-a04f-31d919e39ff6 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:01.059531 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f5271505-ca4b-4abf-a04f-31d919e39ff6 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1678 microversion: 2.1 time: 0.151430 Jul 25 23:08:01.073159 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 255/511] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:00 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:01.182609 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-02eb8b1d-fd0d-4e66-84d0-5b91b21becb5 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:01.191063 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-02eb8b1d-fd0d-4e66-84d0-5b91b21becb5 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1733 microversion: 2.1 time: 0.159384 Jul 25 23:08:01.191622 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 257/512] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:01 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:08:01.639646 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5fb7884f-bfc1-4543-9346-d223cbdfb5db tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:01.640247 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-5fb7884f-bfc1-4543-9346-d223cbdfb5db tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:01.647153 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5fb7884f-bfc1-4543-9346-d223cbdfb5db tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:01.647592 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5fb7884f-bfc1-4543-9346-d223cbdfb5db tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:01.648367 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5fb7884f-bfc1-4543-9346-d223cbdfb5db tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:01.649032 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5fb7884f-bfc1-4543-9346-d223cbdfb5db tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:01.667645 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:08:01.779258 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-5fb7884f-bfc1-4543-9346-d223cbdfb5db tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:01.786959 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-5fb7884f-bfc1-4543-9346-d223cbdfb5db tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5" status: 200 len: 1514 microversion: 2.1 time: 0.151258 Jul 25 23:08:01.787533 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 256/513] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:01 2022] GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:02.083656 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-97df9afd-1245-40fe-a771-f58c959f78b2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:02.084281 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-97df9afd-1245-40fe-a771-f58c959f78b2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:02.091375 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-97df9afd-1245-40fe-a771-f58c959f78b2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:02.091820 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-97df9afd-1245-40fe-a771-f58c959f78b2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:02.092599 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-97df9afd-1245-40fe-a771-f58c959f78b2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:02.093027 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-97df9afd-1245-40fe-a771-f58c959f78b2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:02.211796 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d0579afe-d061-4db1-b496-d6f9a0bee177 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:02.212524 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-d0579afe-d061-4db1-b496-d6f9a0bee177 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:02.215016 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:08:02.219772 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d0579afe-d061-4db1-b496-d6f9a0bee177 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:02.220221 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d0579afe-d061-4db1-b496-d6f9a0bee177 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:02.221017 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d0579afe-d061-4db1-b496-d6f9a0bee177 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:02.221513 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d0579afe-d061-4db1-b496-d6f9a0bee177 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:02.261580 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-97df9afd-1245-40fe-a771-f58c959f78b2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:02.269282 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-97df9afd-1245-40fe-a771-f58c959f78b2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1678 microversion: 2.1 time: 0.190842 Jul 25 23:08:02.272316 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 258/514] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:02 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1678 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:02.362007 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-d0579afe-d061-4db1-b496-d6f9a0bee177 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:02.369946 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-d0579afe-d061-4db1-b496-d6f9a0bee177 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1733 microversion: 2.1 time: 0.162016 Jul 25 23:08:02.370529 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 257/515] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:02 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1733 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:08:02.808202 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-0a08d73c-33c1-4b88-8e12-6725fdb11845 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:02.808720 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-0a08d73c-33c1-4b88-8e12-6725fdb11845 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:02.815288 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0a08d73c-33c1-4b88-8e12-6725fdb11845 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:02.815741 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0a08d73c-33c1-4b88-8e12-6725fdb11845 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:02.816517 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0a08d73c-33c1-4b88-8e12-6725fdb11845 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:02.816960 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0a08d73c-33c1-4b88-8e12-6725fdb11845 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:03.075937 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-0a08d73c-33c1-4b88-8e12-6725fdb11845 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:03.084753 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-0a08d73c-33c1-4b88-8e12-6725fdb11845 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5" status: 200 len: 1514 microversion: 2.1 time: 0.280534 Jul 25 23:08:03.091308 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 259/516] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:02 2022] GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5 => generated 1514 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:03.291217 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b1c95a50-0381-48c4-bd2b-8ee52a47e8d3 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:03.292497 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b1c95a50-0381-48c4-bd2b-8ee52a47e8d3 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:03.299711 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b1c95a50-0381-48c4-bd2b-8ee52a47e8d3 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:03.300134 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b1c95a50-0381-48c4-bd2b-8ee52a47e8d3 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:03.300936 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b1c95a50-0381-48c4-bd2b-8ee52a47e8d3 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:03.301396 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b1c95a50-0381-48c4-bd2b-8ee52a47e8d3 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:03.392568 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-0f9359b6-72a3-4266-afcb-03ef833bd638 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:03.393296 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-0f9359b6-72a3-4266-afcb-03ef833bd638 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:03.400442 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0f9359b6-72a3-4266-afcb-03ef833bd638 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:03.400964 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0f9359b6-72a3-4266-afcb-03ef833bd638 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:03.401982 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0f9359b6-72a3-4266-afcb-03ef833bd638 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:03.402480 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0f9359b6-72a3-4266-afcb-03ef833bd638 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:03.459932 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b1c95a50-0381-48c4-bd2b-8ee52a47e8d3 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:03.467523 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b1c95a50-0381-48c4-bd2b-8ee52a47e8d3 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1655 microversion: 2.1 time: 0.180494 Jul 25 23:08:03.468088 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 258/517] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:03 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1655 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:03.472449 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-46cab29c-8d73-4f0a-ad85-8292ddd08998 req-ad699d64-f7eb-4fe7-b06c-8eee9ea84f38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5", "name": "network-vif-deleted", "tag": "200e143d-89ff-4640-9b7b-c58b893181a2"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:08:03.482095 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-46cab29c-8d73-4f0a-ad85-8292ddd08998 req-ad699d64-f7eb-4fe7-b06c-8eee9ea84f38 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:03.482535 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-46cab29c-8d73-4f0a-ad85-8292ddd08998 req-ad699d64-f7eb-4fe7-b06c-8eee9ea84f38 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:03.495825 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-46cab29c-8d73-4f0a-ad85-8292ddd08998 req-ad699d64-f7eb-4fe7-b06c-8eee9ea84f38 service nova] Creating event network-vif-deleted:200e143d-89ff-4640-9b7b-c58b893181a2 for instance fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5 on hv-cinder-79760 Jul 25 23:08:03.500893 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-46cab29c-8d73-4f0a-ad85-8292ddd08998 req-ad699d64-f7eb-4fe7-b06c-8eee9ea84f38 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031708 Jul 25 23:08:03.502046 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 259/518] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:08:03.507102 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-03eed84c-c477-47f4-b8b2-f1b965ef64bd tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:08:03.513357 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-03eed84c-c477-47f4-b8b2-f1b965ef64bd tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:03.513806 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-03eed84c-c477-47f4-b8b2-f1b965ef64bd tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:03.537234 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-03eed84c-c477-47f4-b8b2-f1b965ef64bd tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Going to try to start instance {{(pid=118410) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 25 23:08:03.548333 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-0f9359b6-72a3-4266-afcb-03ef833bd638 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:03.556330 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-0f9359b6-72a3-4266-afcb-03ef833bd638 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1733 microversion: 2.1 time: 0.168247 Jul 25 23:08:03.556898 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 260/519] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:03 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1733 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:08:03.718866 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-03eed84c-c477-47f4-b8b2-f1b965ef64bd tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "POST /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d/action" status: 202 len: 0 microversion: 2.1 time: 0.215357 Jul 25 23:08:03.719703 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 260/520] 10.222.0.55 () {60 vars in 1278 bytes} [Mon Jul 25 23:08:03 2022] POST /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 23:08:03.727872 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-e2cd10da-6b72-41fb-ac34-b6d563626cf5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:03.728481 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-e2cd10da-6b72-41fb-ac34-b6d563626cf5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:03.734545 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e2cd10da-6b72-41fb-ac34-b6d563626cf5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:03.735051 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e2cd10da-6b72-41fb-ac34-b6d563626cf5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:03.736346 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e2cd10da-6b72-41fb-ac34-b6d563626cf5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:03.736855 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e2cd10da-6b72-41fb-ac34-b6d563626cf5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:03.872511 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-e2cd10da-6b72-41fb-ac34-b6d563626cf5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:03.882255 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-e2cd10da-6b72-41fb-ac34-b6d563626cf5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1664 microversion: 2.1 time: 0.158110 Jul 25 23:08:03.882847 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 261/521] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:03 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1664 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:04.108452 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f02b3ba9-3ae8-48b9-9246-673a654b0be6 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:04.109141 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f02b3ba9-3ae8-48b9-9246-673a654b0be6 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:04.116298 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f02b3ba9-3ae8-48b9-9246-673a654b0be6 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:04.116721 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f02b3ba9-3ae8-48b9-9246-673a654b0be6 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:04.117509 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f02b3ba9-3ae8-48b9-9246-673a654b0be6 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:04.117940 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f02b3ba9-3ae8-48b9-9246-673a654b0be6 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:04.180452 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f02b3ba9-3ae8-48b9-9246-673a654b0be6 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:04.188142 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f02b3ba9-3ae8-48b9-9246-673a654b0be6 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5" status: 200 len: 1304 microversion: 2.1 time: 0.083874 Jul 25 23:08:04.188765 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 261/522] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:04 2022] GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5 => generated 1304 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:04.578167 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-139212a3-45e5-4f7a-9276-afbb20ebb0bc tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:04.578756 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-139212a3-45e5-4f7a-9276-afbb20ebb0bc tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:04.585786 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-139212a3-45e5-4f7a-9276-afbb20ebb0bc tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:04.586229 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-139212a3-45e5-4f7a-9276-afbb20ebb0bc tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:04.586987 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-139212a3-45e5-4f7a-9276-afbb20ebb0bc tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:04.587415 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-139212a3-45e5-4f7a-9276-afbb20ebb0bc tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:04.720407 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-139212a3-45e5-4f7a-9276-afbb20ebb0bc tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:04.728358 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-139212a3-45e5-4f7a-9276-afbb20ebb0bc tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1733 microversion: 2.1 time: 0.154057 Jul 25 23:08:04.728920 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 262/523] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:04 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:08:04.904056 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-ccd23414-a514-4975-8ab4-41f393d7d1f4 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:04.904659 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-ccd23414-a514-4975-8ab4-41f393d7d1f4 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:04.911587 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ccd23414-a514-4975-8ab4-41f393d7d1f4 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:04.916564 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ccd23414-a514-4975-8ab4-41f393d7d1f4 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:04.916564 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ccd23414-a514-4975-8ab4-41f393d7d1f4 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:04.916564 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ccd23414-a514-4975-8ab4-41f393d7d1f4 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:05.052279 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ccd23414-a514-4975-8ab4-41f393d7d1f4 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:05.061221 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-ccd23414-a514-4975-8ab4-41f393d7d1f4 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1664 microversion: 2.1 time: 0.160948 Jul 25 23:08:05.061998 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 262/524] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:04 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1664 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:05.208711 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-381a785a-e91f-4ddd-b6e3-4814f494ce86 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:05.209281 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-381a785a-e91f-4ddd-b6e3-4814f494ce86 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:05.215328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-381a785a-e91f-4ddd-b6e3-4814f494ce86 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:05.215783 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-381a785a-e91f-4ddd-b6e3-4814f494ce86 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:05.216548 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-381a785a-e91f-4ddd-b6e3-4814f494ce86 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:05.216984 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-381a785a-e91f-4ddd-b6e3-4814f494ce86 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:05.230330 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.wsgi [None req-381a785a-e91f-4ddd-b6e3-4814f494ce86 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] HTTP exception thrown: Instance fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5 could not be found. Jul 25 23:08:05.231988 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-381a785a-e91f-4ddd-b6e3-4814f494ce86 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Request method failure captured: Jul 25 23:08:05.231988 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: request: GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5 HTTP/1.1 Jul 25 23:08:05.231988 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept: application/json Jul 25 23:08:05.231988 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept-Encoding: identity Jul 25 23:08:05.231988 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Connection: close Jul 25 23:08:05.231988 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Length: 0 Jul 25 23:08:05.231988 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Type: application/json Jul 25 23:08:05.231988 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Host: 10.222.0.55 Jul 25 23:08:05.231988 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Openstack-System-Scope: None Jul 25 23:08:05.231988 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: User-Agent: python-urllib3/1.26.10 Jul 25 23:08:05.231988 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Auth-Token: gAAAAABi3yHtyuJZwLfjpoydB1MfpjCFGlaabIxaQ5JyHTkarO7Nhca2Lvy_3HpY3fGgXsz-_83S1DcuZQQ6FNMQ3ML2Se2ugfAP09Fkz0UTyeruM4jlMx7GE0V66eQNPt7H87dIVOloQfF9ZZEY0_VN0PaEnhVruZjW1R3mjdQeH5cbcC_sXP4 Jul 25 23:08:05.231988 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Id: None Jul 25 23:08:05.231988 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Name: None Jul 25 23:08:05.231988 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Identity-Status: Confirmed Jul 25 23:08:05.231988 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Is-Admin-Project: True Jul 25 23:08:05.231988 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Id: default Jul 25 23:08:05.231988 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Name: Default Jul 25 23:08:05.231988 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Id: 78f2a5cc4b7d4699ad5b00d3f3a9830e Jul 25 23:08:05.231988 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1152508385 Jul 25 23:08:05.231988 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Role: reader,member Jul 25 23:08:05.231988 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Roles: reader,member Jul 25 23:08:05.233578 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/78f2a5cc4b7d4699ad5b00d3f3a9830e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/78f2a5cc4b7d4699ad5b00d3f3a9830e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_78f2a5cc4b7d4699ad5b00d3f3a9830e", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/78f2a5cc4b7d4699ad5b00d3f3a9830e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:08:05.233578 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant: tempest-VolumesSnapshotTestJSON-1152508385 Jul 25 23:08:05.233578 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Id: 78f2a5cc4b7d4699ad5b00d3f3a9830e Jul 25 23:08:05.233578 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1152508385 Jul 25 23:08:05.233578 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User: tempest-VolumesSnapshotTestJSON-1152508385-project Jul 25 23:08:05.233578 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Id: default Jul 25 23:08:05.233578 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Name: Default Jul 25 23:08:05.233578 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Id: ec45d64732fe4aac9fe6b9d6cd04a6f4 Jul 25 23:08:05.233578 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Name: tempest-VolumesSnapshotTestJSON-1152508385-project Jul 25 23:08:05.233578 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: method: > Jul 25 23:08:05.233578 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: exception: Instance fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5 could not be found. Jul 25 23:08:05.233578 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: action_args: {'id': 'fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5'} Jul 25 23:08:05.234511 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:08:05.234511 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:08:05.234511 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:08:05.234511 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:08:05.234511 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:08:05.234511 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:08:05.234511 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:08:05.234511 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:08:05.234511 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:08:05.234511 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:08:05.234511 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5 could not be found. Jul 25 23:08:05.234511 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:08:05.234511 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:08:05.234511 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:08:05.234511 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:08:05.234511 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:08:05.234511 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:08:05.234511 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:08:05.234511 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:08:05.234511 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:08:05.236983 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:08:05.236983 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 23:08:05.236983 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 23:08:05.236983 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:08:05.236983 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:08:05.236983 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:08:05.236983 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:08:05.236983 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5 could not be found. Jul 25 23:08:05.236983 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:08:05.236983 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:08:05.236983 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:08:05.236983 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:08:05.236983 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:08:05.236983 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:08:05.236983 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:08:05.236983 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:08:05.236983 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5 could not be found. Jul 25 23:08:05.236983 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:08:05.238108 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-381a785a-e91f-4ddd-b6e3-4814f494ce86 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Returning 404 to user: Instance fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5 could not be found. {{(pid=118409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:08:05.238108 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-381a785a-e91f-4ddd-b6e3-4814f494ce86 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5" status: 404 len: 111 microversion: 2.1 time: 0.029056 Jul 25 23:08:05.238108 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 263/525] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:05 2022] GET /compute/v2.1/servers/fb9087c0-2767-4cd8-bed2-2aa93e5fa9b5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:08:05.749503 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-065c07d7-8d2f-44a1-b43d-37a0f4698696 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:05.750024 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-065c07d7-8d2f-44a1-b43d-37a0f4698696 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:05.756191 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-065c07d7-8d2f-44a1-b43d-37a0f4698696 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:05.756620 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-065c07d7-8d2f-44a1-b43d-37a0f4698696 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:05.757412 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-065c07d7-8d2f-44a1-b43d-37a0f4698696 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:05.757850 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-065c07d7-8d2f-44a1-b43d-37a0f4698696 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:05.896651 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-065c07d7-8d2f-44a1-b43d-37a0f4698696 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:05.905112 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-065c07d7-8d2f-44a1-b43d-37a0f4698696 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1733 microversion: 2.1 time: 0.159560 Jul 25 23:08:05.905755 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 263/526] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:05 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:06.083215 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-75029aa4-7d80-4aac-b831-450045fc54d0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:06.083767 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-75029aa4-7d80-4aac-b831-450045fc54d0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:06.086117 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_api:SELECT=48 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:08:06.090966 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-75029aa4-7d80-4aac-b831-450045fc54d0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:06.091395 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-75029aa4-7d80-4aac-b831-450045fc54d0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:06.092214 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-75029aa4-7d80-4aac-b831-450045fc54d0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:06.092632 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-75029aa4-7d80-4aac-b831-450045fc54d0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:06.226057 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-75029aa4-7d80-4aac-b831-450045fc54d0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:06.233500 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-75029aa4-7d80-4aac-b831-450045fc54d0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1664 microversion: 2.1 time: 0.154712 Jul 25 23:08:06.234067 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 264/527] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:06 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1664 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:06.928023 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-da5c5771-3707-4313-bd14-49ad20e7f18c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:06.928620 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-da5c5771-3707-4313-bd14-49ad20e7f18c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:06.935276 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-da5c5771-3707-4313-bd14-49ad20e7f18c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:06.935696 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-da5c5771-3707-4313-bd14-49ad20e7f18c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:06.936457 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-da5c5771-3707-4313-bd14-49ad20e7f18c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:06.936888 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-da5c5771-3707-4313-bd14-49ad20e7f18c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:07.074110 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-da5c5771-3707-4313-bd14-49ad20e7f18c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:07.083320 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-da5c5771-3707-4313-bd14-49ad20e7f18c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1733 microversion: 2.1 time: 0.159683 Jul 25 23:08:07.083955 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 264/528] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:06 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:07.254966 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-6b47f948-bd8a-4e31-80cf-b213517e3b49 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:07.255596 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-6b47f948-bd8a-4e31-80cf-b213517e3b49 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:07.262070 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6b47f948-bd8a-4e31-80cf-b213517e3b49 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:07.262512 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6b47f948-bd8a-4e31-80cf-b213517e3b49 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:07.263272 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6b47f948-bd8a-4e31-80cf-b213517e3b49 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:07.263701 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6b47f948-bd8a-4e31-80cf-b213517e3b49 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:07.402633 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-6b47f948-bd8a-4e31-80cf-b213517e3b49 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:07.411588 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-6b47f948-bd8a-4e31-80cf-b213517e3b49 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1664 microversion: 2.1 time: 0.160617 Jul 25 23:08:07.412141 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 265/529] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:07 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1664 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:08.106967 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-cbd88a61-2a68-446d-a892-f77e438235e5 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:08.113996 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-cbd88a61-2a68-446d-a892-f77e438235e5 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:08.115284 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cbd88a61-2a68-446d-a892-f77e438235e5 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:08.115805 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cbd88a61-2a68-446d-a892-f77e438235e5 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:08.116569 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cbd88a61-2a68-446d-a892-f77e438235e5 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:08.117014 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cbd88a61-2a68-446d-a892-f77e438235e5 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:08.248076 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-cbd88a61-2a68-446d-a892-f77e438235e5 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:08.257138 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-cbd88a61-2a68-446d-a892-f77e438235e5 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1733 microversion: 2.1 time: 0.154352 Jul 25 23:08:08.257709 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 265/530] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:08 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:08.433455 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-a7e9cf94-2dbc-426b-98e7-0a197b51cf8d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:08.434043 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-a7e9cf94-2dbc-426b-98e7-0a197b51cf8d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:08.441056 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a7e9cf94-2dbc-426b-98e7-0a197b51cf8d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:08.441540 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a7e9cf94-2dbc-426b-98e7-0a197b51cf8d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:08.442275 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a7e9cf94-2dbc-426b-98e7-0a197b51cf8d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:08.442698 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a7e9cf94-2dbc-426b-98e7-0a197b51cf8d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:08.574644 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-a7e9cf94-2dbc-426b-98e7-0a197b51cf8d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:08.582909 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-a7e9cf94-2dbc-426b-98e7-0a197b51cf8d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1664 microversion: 2.1 time: 0.153345 Jul 25 23:08:08.583483 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 266/531] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:08 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1664 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:09.279082 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b72677ac-04ba-480b-aca7-3933be256997 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:09.279670 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b72677ac-04ba-480b-aca7-3933be256997 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:09.287044 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b72677ac-04ba-480b-aca7-3933be256997 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:09.287487 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b72677ac-04ba-480b-aca7-3933be256997 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:09.288247 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b72677ac-04ba-480b-aca7-3933be256997 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:09.288673 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b72677ac-04ba-480b-aca7-3933be256997 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:09.424685 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b72677ac-04ba-480b-aca7-3933be256997 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:09.432756 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b72677ac-04ba-480b-aca7-3933be256997 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1733 microversion: 2.1 time: 0.157391 Jul 25 23:08:09.433408 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 266/532] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:09 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:09.604198 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-95613053-a189-4aa1-9d5d-6572e037ef5a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:09.604867 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-95613053-a189-4aa1-9d5d-6572e037ef5a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:09.612428 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-95613053-a189-4aa1-9d5d-6572e037ef5a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:09.615315 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-95613053-a189-4aa1-9d5d-6572e037ef5a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:09.615315 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-95613053-a189-4aa1-9d5d-6572e037ef5a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:09.615315 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-95613053-a189-4aa1-9d5d-6572e037ef5a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:09.750934 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-95613053-a189-4aa1-9d5d-6572e037ef5a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:09.759446 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-95613053-a189-4aa1-9d5d-6572e037ef5a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1668 microversion: 2.1 time: 0.159095 Jul 25 23:08:09.760051 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 267/533] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:09 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1668 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:10.458555 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4561cdae-05c1-4367-8981-8fe7092a139e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:10.459161 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4561cdae-05c1-4367-8981-8fe7092a139e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:10.465919 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4561cdae-05c1-4367-8981-8fe7092a139e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:10.466369 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4561cdae-05c1-4367-8981-8fe7092a139e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:10.471837 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4561cdae-05c1-4367-8981-8fe7092a139e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:10.471837 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4561cdae-05c1-4367-8981-8fe7092a139e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:10.600912 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4561cdae-05c1-4367-8981-8fe7092a139e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:10.609219 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4561cdae-05c1-4367-8981-8fe7092a139e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1733 microversion: 2.1 time: 0.155087 Jul 25 23:08:10.611218 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 267/534] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:10 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:11.635772 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-480ef1ba-b9eb-41e5-8f39-e872893b5f2c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:11.636403 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-480ef1ba-b9eb-41e5-8f39-e872893b5f2c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:11.643192 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-480ef1ba-b9eb-41e5-8f39-e872893b5f2c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:11.643852 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-480ef1ba-b9eb-41e5-8f39-e872893b5f2c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:11.644667 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-480ef1ba-b9eb-41e5-8f39-e872893b5f2c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:11.645100 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-480ef1ba-b9eb-41e5-8f39-e872893b5f2c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:11.779046 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-480ef1ba-b9eb-41e5-8f39-e872893b5f2c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:11.787829 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-480ef1ba-b9eb-41e5-8f39-e872893b5f2c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1733 microversion: 2.1 time: 0.156038 Jul 25 23:08:11.788413 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 268/535] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:11 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:12.810283 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-9ab12ce0-b87e-4860-84a3-5caf41a0e714 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:12.810824 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-9ab12ce0-b87e-4860-84a3-5caf41a0e714 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:12.818668 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9ab12ce0-b87e-4860-84a3-5caf41a0e714 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:12.819112 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9ab12ce0-b87e-4860-84a3-5caf41a0e714 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:12.819879 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9ab12ce0-b87e-4860-84a3-5caf41a0e714 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:12.820307 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9ab12ce0-b87e-4860-84a3-5caf41a0e714 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:12.958912 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9ab12ce0-b87e-4860-84a3-5caf41a0e714 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:12.967044 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-9ab12ce0-b87e-4860-84a3-5caf41a0e714 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1733 microversion: 2.1 time: 0.160730 Jul 25 23:08:12.967609 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 268/536] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:12 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:13.988814 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-3f85ce82-8d28-4e10-a805-8bce9d0c97af tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:13.989539 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-3f85ce82-8d28-4e10-a805-8bce9d0c97af tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:13.995952 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3f85ce82-8d28-4e10-a805-8bce9d0c97af tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:13.996355 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3f85ce82-8d28-4e10-a805-8bce9d0c97af tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:13.997134 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3f85ce82-8d28-4e10-a805-8bce9d0c97af tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:13.997563 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3f85ce82-8d28-4e10-a805-8bce9d0c97af tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:14.129341 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-3f85ce82-8d28-4e10-a805-8bce9d0c97af tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:14.132839 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:08:14.137552 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-3f85ce82-8d28-4e10-a805-8bce9d0c97af tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1733 microversion: 2.1 time: 0.152606 Jul 25 23:08:14.138108 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 269/537] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:13 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:15.160177 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-aff1d96c-5e4e-4ae4-97d3-62934a6d2cb4 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:15.160785 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-aff1d96c-5e4e-4ae4-97d3-62934a6d2cb4 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:15.167524 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-aff1d96c-5e4e-4ae4-97d3-62934a6d2cb4 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:15.167962 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-aff1d96c-5e4e-4ae4-97d3-62934a6d2cb4 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:15.168764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-aff1d96c-5e4e-4ae4-97d3-62934a6d2cb4 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:15.169217 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-aff1d96c-5e4e-4ae4-97d3-62934a6d2cb4 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:15.324094 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-aff1d96c-5e4e-4ae4-97d3-62934a6d2cb4 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:15.334051 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-aff1d96c-5e4e-4ae4-97d3-62934a6d2cb4 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1733 microversion: 2.1 time: 0.178747 Jul 25 23:08:15.334652 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 269/538] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:15 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1733 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:15.730205 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-ff252736-5a64-4d33-8362-297ce7094c44 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1931456949", "imageRef": "8e9f3265-0fdf-483a-8e2e-41d408f5f0e7", "flavorRef": "452", "networks": [{"uuid": "400f5b04-571f-4657-816e-0dd50576e231"}]}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:08:15.788493 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.network.neutron [None req-ff252736-5a64-4d33-8362-297ce7094c44 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] validate_networks() for [('400f5b04-571f-4657-816e-0dd50576e231', None, None, None, None, None)] {{(pid=118409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 23:08:16.357083 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-065443b7-df8a-4cdd-a68c-3001e92ba933 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:16.357739 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-065443b7-df8a-4cdd-a68c-3001e92ba933 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:16.365461 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-065443b7-df8a-4cdd-a68c-3001e92ba933 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:16.366270 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-065443b7-df8a-4cdd-a68c-3001e92ba933 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:16.366707 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-065443b7-df8a-4cdd-a68c-3001e92ba933 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:16.367148 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-065443b7-df8a-4cdd-a68c-3001e92ba933 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:16.418192 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-ff252736-5a64-4d33-8362-297ce7094c44 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Flavor limits 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 23:08:16.418614 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-ff252736-5a64-4d33-8362-297ce7094c44 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Image limits 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 23:08:16.419406 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-ff252736-5a64-4d33-8362-297ce7094c44 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Flavor pref 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 23:08:16.419870 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-ff252736-5a64-4d33-8362-297ce7094c44 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Image pref 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 23:08:16.420799 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-ff252736-5a64-4d33-8362-297ce7094c44 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 23:08:16.440379 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ff252736-5a64-4d33-8362-297ce7094c44 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:16.440379 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ff252736-5a64-4d33-8362-297ce7094c44 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:16.440379 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ff252736-5a64-4d33-8362-297ce7094c44 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:16.440379 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ff252736-5a64-4d33-8362-297ce7094c44 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:16.459229 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-ff252736-5a64-4d33-8362-297ce7094c44 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Getting quotas for project 78f2a5cc4b7d4699ad5b00d3f3a9830e. Resources: {'instances', 'cores', 'ram'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 23:08:16.463478 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-ff252736-5a64-4d33-8362-297ce7094c44 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Getting quotas for user ec45d64732fe4aac9fe6b9d6cd04a6f4 and project 78f2a5cc4b7d4699ad5b00d3f3a9830e. Resources: {'instances', 'cores', 'ram'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 23:08:16.477415 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-ff252736-5a64-4d33-8362-297ce7094c44 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Going to run 1 instances... {{(pid=118409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 23:08:16.479771 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-ff252736-5a64-4d33-8362-297ce7094c44 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fd5cd68d-b7c2-48c3-813a-337a6ba8472f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e9f3265-0fdf-483a-8e2e-41d408f5f0e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 23:08:16.504944 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-065443b7-df8a-4cdd-a68c-3001e92ba933 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:16.513040 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-065443b7-df8a-4cdd-a68c-3001e92ba933 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1733 microversion: 2.1 time: 0.159912 Jul 25 23:08:16.513677 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 270/539] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:16 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:16.608409 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-ff252736-5a64-4d33-8362-297ce7094c44 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.882477 Jul 25 23:08:16.609053 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 270/540] 10.222.0.55 () {60 vars in 1147 bytes} [Mon Jul 25 23:08:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 23:08:16.621430 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-010b495f-a9bd-4135-8273-cf8a776c7eb3 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:16.622050 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-010b495f-a9bd-4135-8273-cf8a776c7eb3 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fd5cd68d-b7c2-48c3-813a-337a6ba8472f] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:16.678774 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-010b495f-a9bd-4135-8273-cf8a776c7eb3 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:16.686116 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-010b495f-a9bd-4135-8273-cf8a776c7eb3 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f" status: 200 len: 1219 microversion: 2.1 time: 0.069071 Jul 25 23:08:16.686687 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 271/541] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:16 2022] GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:17.534960 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-2469d1e9-3521-4ef8-ac1e-a16dac6bd06b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:17.535582 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-2469d1e9-3521-4ef8-ac1e-a16dac6bd06b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:17.545203 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2469d1e9-3521-4ef8-ac1e-a16dac6bd06b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:17.545656 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2469d1e9-3521-4ef8-ac1e-a16dac6bd06b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:17.546421 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2469d1e9-3521-4ef8-ac1e-a16dac6bd06b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:17.546855 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2469d1e9-3521-4ef8-ac1e-a16dac6bd06b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:17.688594 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-2469d1e9-3521-4ef8-ac1e-a16dac6bd06b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:17.697676 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-2469d1e9-3521-4ef8-ac1e-a16dac6bd06b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1733 microversion: 2.1 time: 0.166659 Jul 25 23:08:17.698245 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 271/542] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:17 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:17.710324 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-51c9953b-252c-474c-8dc9-63d2b5ed6979 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:17.710929 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-51c9953b-252c-474c-8dc9-63d2b5ed6979 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fd5cd68d-b7c2-48c3-813a-337a6ba8472f] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:17.718049 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-51c9953b-252c-474c-8dc9-63d2b5ed6979 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:17.718495 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-51c9953b-252c-474c-8dc9-63d2b5ed6979 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:17.722541 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-51c9953b-252c-474c-8dc9-63d2b5ed6979 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:17.722541 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-51c9953b-252c-474c-8dc9-63d2b5ed6979 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:17.787921 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-51c9953b-252c-474c-8dc9-63d2b5ed6979 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:17.795632 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-51c9953b-252c-474c-8dc9-63d2b5ed6979 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f" status: 200 len: 1223 microversion: 2.1 time: 0.092121 Jul 25 23:08:17.796205 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 272/543] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:17 2022] GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:18.719776 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-95c2f93a-1d3f-47ba-85d8-2b22e0c38370 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:18.720375 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-95c2f93a-1d3f-47ba-85d8-2b22e0c38370 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:18.727651 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-95c2f93a-1d3f-47ba-85d8-2b22e0c38370 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:18.728176 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-95c2f93a-1d3f-47ba-85d8-2b22e0c38370 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:18.729089 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-95c2f93a-1d3f-47ba-85d8-2b22e0c38370 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:18.729546 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-95c2f93a-1d3f-47ba-85d8-2b22e0c38370 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:18.816522 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-12987bac-1bd5-4c85-b92d-01a83ce30293 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:18.817726 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-12987bac-1bd5-4c85-b92d-01a83ce30293 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fd5cd68d-b7c2-48c3-813a-337a6ba8472f] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:18.824223 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-12987bac-1bd5-4c85-b92d-01a83ce30293 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:18.824669 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-12987bac-1bd5-4c85-b92d-01a83ce30293 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:18.825653 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-12987bac-1bd5-4c85-b92d-01a83ce30293 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:18.826083 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-12987bac-1bd5-4c85-b92d-01a83ce30293 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:18.894175 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-95c2f93a-1d3f-47ba-85d8-2b22e0c38370 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:18.903407 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-95c2f93a-1d3f-47ba-85d8-2b22e0c38370 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1733 microversion: 2.1 time: 0.187468 Jul 25 23:08:18.913062 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-12987bac-1bd5-4c85-b92d-01a83ce30293 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:18.916579 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:08:18.917507 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 272/544] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:18 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1733 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:18.931986 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-12987bac-1bd5-4c85-b92d-01a83ce30293 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f" status: 200 len: 1279 microversion: 2.1 time: 0.109967 Jul 25 23:08:18.931986 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 273/545] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:18 2022] GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f => generated 1279 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:08:19.926744 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-e3f78c2e-b7cc-4afb-afca-178ed14f500c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:19.927306 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-e3f78c2e-b7cc-4afb-afca-178ed14f500c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:19.934388 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e3f78c2e-b7cc-4afb-afca-178ed14f500c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:19.934835 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e3f78c2e-b7cc-4afb-afca-178ed14f500c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:19.935628 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e3f78c2e-b7cc-4afb-afca-178ed14f500c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:19.936063 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e3f78c2e-b7cc-4afb-afca-178ed14f500c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:19.952204 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-bbe6bf5a-c899-4385-ac21-ecbb2898c027 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:19.953754 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-bbe6bf5a-c899-4385-ac21-ecbb2898c027 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fd5cd68d-b7c2-48c3-813a-337a6ba8472f] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:19.961986 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bbe6bf5a-c899-4385-ac21-ecbb2898c027 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:19.966016 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bbe6bf5a-c899-4385-ac21-ecbb2898c027 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:19.966016 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bbe6bf5a-c899-4385-ac21-ecbb2898c027 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:19.966016 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bbe6bf5a-c899-4385-ac21-ecbb2898c027 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:20.145649 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-e3f78c2e-b7cc-4afb-afca-178ed14f500c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:20.153400 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-bbe6bf5a-c899-4385-ac21-ecbb2898c027 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:20.153900 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-e3f78c2e-b7cc-4afb-afca-178ed14f500c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1733 microversion: 2.1 time: 0.231941 Jul 25 23:08:20.154479 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 273/546] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:19 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1733 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:20.162386 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-bbe6bf5a-c899-4385-ac21-ecbb2898c027 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f" status: 200 len: 1319 microversion: 2.1 time: 0.214546 Jul 25 23:08:20.162955 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 274/547] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:19 2022] GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:08:21.176492 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-6f9825b9-1ee1-4c64-8e24-6a92e72e1433 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:21.177514 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-6f9825b9-1ee1-4c64-8e24-6a92e72e1433 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:21.184417 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f3d3bdd3-3c5c-4efa-837b-d5848e2ddcff tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:21.185111 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6f9825b9-1ee1-4c64-8e24-6a92e72e1433 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:21.185348 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f3d3bdd3-3c5c-4efa-837b-d5848e2ddcff tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fd5cd68d-b7c2-48c3-813a-337a6ba8472f] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:21.186028 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6f9825b9-1ee1-4c64-8e24-6a92e72e1433 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:21.186810 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6f9825b9-1ee1-4c64-8e24-6a92e72e1433 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:21.187415 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6f9825b9-1ee1-4c64-8e24-6a92e72e1433 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:21.193481 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f3d3bdd3-3c5c-4efa-837b-d5848e2ddcff tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:21.194083 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f3d3bdd3-3c5c-4efa-837b-d5848e2ddcff tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:21.195014 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f3d3bdd3-3c5c-4efa-837b-d5848e2ddcff tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:21.195451 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f3d3bdd3-3c5c-4efa-837b-d5848e2ddcff tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:21.385546 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-6f9825b9-1ee1-4c64-8e24-6a92e72e1433 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:21.392518 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f3d3bdd3-3c5c-4efa-837b-d5848e2ddcff tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:21.393926 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-6f9825b9-1ee1-4c64-8e24-6a92e72e1433 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1733 microversion: 2.1 time: 0.222011 Jul 25 23:08:21.394505 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 274/548] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:21 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1733 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:21.399421 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-b343b81e-da27-4b95-9bf1-97f2feaf3fc1 req-ed46abe7-10d2-4b9e-af86-e3709366bb89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd5cd68d-b7c2-48c3-813a-337a6ba8472f", "tag": "ef2b1954-33ca-4375-97d3-e90ba0e025ed"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:08:21.400497 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f3d3bdd3-3c5c-4efa-837b-d5848e2ddcff tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f" status: 200 len: 1319 microversion: 2.1 time: 0.220426 Jul 25 23:08:21.401284 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 275/549] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:21 2022] GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:08:21.414070 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-b343b81e-da27-4b95-9bf1-97f2feaf3fc1 req-ed46abe7-10d2-4b9e-af86-e3709366bb89 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:21.414514 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-b343b81e-da27-4b95-9bf1-97f2feaf3fc1 req-ed46abe7-10d2-4b9e-af86-e3709366bb89 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:21.425777 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-b343b81e-da27-4b95-9bf1-97f2feaf3fc1 req-ed46abe7-10d2-4b9e-af86-e3709366bb89 service nova] Creating event network-changed:ef2b1954-33ca-4375-97d3-e90ba0e025ed for instance fd5cd68d-b7c2-48c3-813a-337a6ba8472f on hv-cinder-79760 Jul 25 23:08:21.430714 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-b343b81e-da27-4b95-9bf1-97f2feaf3fc1 req-ed46abe7-10d2-4b9e-af86-e3709366bb89 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034971 Jul 25 23:08:21.431281 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 275/550] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:08:22.415841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-45d02814-ac2d-4aaa-93b1-2674916603da tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:22.416515 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-45d02814-ac2d-4aaa-93b1-2674916603da tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:22.423147 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-45d02814-ac2d-4aaa-93b1-2674916603da tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:22.423360 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-a10f6996-35f3-4def-8688-754bf63a1f51 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:22.423871 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-45d02814-ac2d-4aaa-93b1-2674916603da tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:22.424409 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-45d02814-ac2d-4aaa-93b1-2674916603da tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:22.424568 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-a10f6996-35f3-4def-8688-754bf63a1f51 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fd5cd68d-b7c2-48c3-813a-337a6ba8472f] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:22.424843 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-45d02814-ac2d-4aaa-93b1-2674916603da tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:22.430925 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a10f6996-35f3-4def-8688-754bf63a1f51 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:22.431294 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a10f6996-35f3-4def-8688-754bf63a1f51 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:22.432051 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a10f6996-35f3-4def-8688-754bf63a1f51 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:22.432479 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a10f6996-35f3-4def-8688-754bf63a1f51 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:22.636182 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-45d02814-ac2d-4aaa-93b1-2674916603da tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:22.639482 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-a10f6996-35f3-4def-8688-754bf63a1f51 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:22.647289 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-45d02814-ac2d-4aaa-93b1-2674916603da tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1713 microversion: 2.1 time: 0.235206 Jul 25 23:08:22.647805 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-a10f6996-35f3-4def-8688-754bf63a1f51 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f" status: 200 len: 1319 microversion: 2.1 time: 0.229427 Jul 25 23:08:22.648630 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 276/551] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:22 2022] GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:08:22.659759 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 276/552] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:22 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1713 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:22.759836 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6c2e3930-cbc2-440d-a80b-a9b7ff0fb43c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:22.760332 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6c2e3930-cbc2-440d-a80b-a9b7ff0fb43c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:22.767056 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6c2e3930-cbc2-440d-a80b-a9b7ff0fb43c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:22.767504 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6c2e3930-cbc2-440d-a80b-a9b7ff0fb43c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:22.768283 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6c2e3930-cbc2-440d-a80b-a9b7ff0fb43c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:22.768718 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6c2e3930-cbc2-440d-a80b-a9b7ff0fb43c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:22.898910 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-6c2e3930-cbc2-440d-a80b-a9b7ff0fb43c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] HTTP exception thrown: Cannot 'detach_volume' instance 6b265736-7f3b-4414-a694-38120987bad8 while it is in vm_state rescued Jul 25 23:08:22.900531 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6c2e3930-cbc2-440d-a80b-a9b7ff0fb43c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Request method failure captured: Jul 25 23:08:22.900531 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: request: DELETE /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8/os-volume_attachments/9d959db9-b729-4321-b55e-5535532598a7 HTTP/1.1 Jul 25 23:08:22.900531 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 25 23:08:22.900531 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 25 23:08:22.900531 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Connection: close Jul 25 23:08:22.900531 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 25 23:08:22.900531 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 25 23:08:22.900531 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Host: 10.222.0.55 Jul 25 23:08:22.900531 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 25 23:08:22.900531 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.10 Jul 25 23:08:22.900531 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABi3yFhkq942vbXnch_IaDKYkO2a3M4yfpDeC2Egpsw0NkwonPh9rBHysX1VIkRqYsB6WQirLUD5WvUZeDdUAXg7TkjmCnSiBSzeoce0TNVhD0leQwr5enAPBpaGFXzPzZMM9NzAOwUv2fBV_BWwBxc9go1JkJZo0Dfjd7PPELR0ji1dFs Jul 25 23:08:22.900531 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 25 23:08:22.900531 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 25 23:08:22.900531 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 25 23:08:22.900531 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 25 23:08:22.900531 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 25 23:08:22.900531 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 25 23:08:22.900531 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Id: d37d3446345749b28d847313e1e6c488 Jul 25 23:08:22.900531 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1178072060 Jul 25 23:08:22.900531 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Role: reader,member Jul 25 23:08:22.900531 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Roles: reader,member Jul 25 23:08:22.902248 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d37d3446345749b28d847313e1e6c488"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d37d3446345749b28d847313e1e6c488"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d37d3446345749b28d847313e1e6c488", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d37d3446345749b28d847313e1e6c488"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:08:22.902248 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1178072060 Jul 25 23:08:22.902248 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Id: d37d3446345749b28d847313e1e6c488 Jul 25 23:08:22.902248 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1178072060 Jul 25 23:08:22.902248 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User: tempest-ServerRescueNegativeTestJSON-1178072060-project Jul 25 23:08:22.902248 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 25 23:08:22.902248 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 25 23:08:22.902248 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Id: 61d3b5a3082a4c74a2a08007581388c0 Jul 25 23:08:22.902248 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1178072060-project Jul 25 23:08:22.902248 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: method: > Jul 25 23:08:22.902248 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: exception: Cannot 'detach_volume' instance 6b265736-7f3b-4414-a694-38120987bad8 while it is in vm_state rescued Jul 25 23:08:22.902971 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: action_args: {'server_id': '6b265736-7f3b-4414-a694-38120987bad8', 'id': '9d959db9-b729-4321-b55e-5535532598a7'} Jul 25 23:08:22.902971 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:08:22.902971 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:08:22.902971 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 25 23:08:22.902971 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 25 23:08:22.902971 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 23:08:22.902971 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 23:08:22.902971 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 25 23:08:22.902971 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 25 23:08:22.902971 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6b265736-7f3b-4414-a694-38120987bad8 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 25 23:08:22.902971 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:08:22.902971 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:08:22.902971 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:08:22.902971 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:08:22.902971 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:08:22.902971 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:08:22.902971 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:08:22.902971 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:08:22.902971 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:08:22.902971 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:08:22.904536 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 25 23:08:22.904536 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 25 23:08:22.904536 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 25 23:08:22.904536 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 25 23:08:22.904536 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6b265736-7f3b-4414-a694-38120987bad8 while it is in vm_state rescued Jul 25 23:08:22.904536 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:08:22.904536 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:08:22.904536 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:08:22.904536 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:08:22.904536 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:08:22.904536 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:08:22.904536 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:08:22.904536 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:08:22.904536 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6b265736-7f3b-4414-a694-38120987bad8 while it is in vm_state rescued Jul 25 23:08:22.904536 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:08:22.904536 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6c2e3930-cbc2-440d-a80b-a9b7ff0fb43c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Returning 409 to user: Cannot 'detach_volume' instance 6b265736-7f3b-4414-a694-38120987bad8 while it is in vm_state rescued {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:08:22.905859 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6c2e3930-cbc2-440d-a80b-a9b7ff0fb43c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8/os-volume_attachments/9d959db9-b729-4321-b55e-5535532598a7" status: 409 len: 152 microversion: 2.1 time: 0.146429 Jul 25 23:08:22.905859 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 277/553] 10.222.0.55 () {58 vars in 1416 bytes} [Mon Jul 25 23:08:22 2022] DELETE /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8/os-volume_attachments/9d959db9-b729-4321-b55e-5535532598a7 => generated 152 bytes in 148 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 25 23:08:22.911134 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-0f9ba3d2-2658-418a-b1d7-c0a536e6708c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:08:22.911671 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-0f9ba3d2-2658-418a-b1d7-c0a536e6708c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:22.917790 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0f9ba3d2-2658-418a-b1d7-c0a536e6708c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:22.918453 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0f9ba3d2-2658-418a-b1d7-c0a536e6708c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:22.919229 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0f9ba3d2-2658-418a-b1d7-c0a536e6708c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:22.919665 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0f9ba3d2-2658-418a-b1d7-c0a536e6708c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:23.164535 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-0f9ba3d2-2658-418a-b1d7-c0a536e6708c tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "POST /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8/action" status: 202 len: 0 microversion: 2.1 time: 0.257184 Jul 25 23:08:23.165338 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 277/554] 10.222.0.55 () {60 vars in 1278 bytes} [Mon Jul 25 23:08:22 2022] POST /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 23:08:23.173186 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b854d50a-0ebe-498e-9f20-9190a901fb0f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:23.173791 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b854d50a-0ebe-498e-9f20-9190a901fb0f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:23.181384 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b854d50a-0ebe-498e-9f20-9190a901fb0f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:23.182683 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b854d50a-0ebe-498e-9f20-9190a901fb0f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:23.183492 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b854d50a-0ebe-498e-9f20-9190a901fb0f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:23.183966 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b854d50a-0ebe-498e-9f20-9190a901fb0f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:23.318811 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b854d50a-0ebe-498e-9f20-9190a901fb0f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:23.326862 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b854d50a-0ebe-498e-9f20-9190a901fb0f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1721 microversion: 2.1 time: 0.157444 Jul 25 23:08:23.327428 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 278/555] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:23 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:23.670350 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-3b93559f-1ac9-4b61-895a-d349f3af8d70 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:23.671052 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-3b93559f-1ac9-4b61-895a-d349f3af8d70 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fd5cd68d-b7c2-48c3-813a-337a6ba8472f] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:23.678290 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3b93559f-1ac9-4b61-895a-d349f3af8d70 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:23.678739 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3b93559f-1ac9-4b61-895a-d349f3af8d70 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:23.679500 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3b93559f-1ac9-4b61-895a-d349f3af8d70 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:23.679934 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3b93559f-1ac9-4b61-895a-d349f3af8d70 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:23.809435 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-3b93559f-1ac9-4b61-895a-d349f3af8d70 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:23.816905 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-3b93559f-1ac9-4b61-895a-d349f3af8d70 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f" status: 200 len: 1319 microversion: 2.1 time: 0.151222 Jul 25 23:08:23.817507 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 278/556] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:23 2022] GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:24.348678 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f0361145-6ecf-43c1-8c43-21880d1369cf tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:24.349359 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f0361145-6ecf-43c1-8c43-21880d1369cf tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:24.355683 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f0361145-6ecf-43c1-8c43-21880d1369cf tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:24.356119 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f0361145-6ecf-43c1-8c43-21880d1369cf tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:24.356880 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f0361145-6ecf-43c1-8c43-21880d1369cf tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:24.357336 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f0361145-6ecf-43c1-8c43-21880d1369cf tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:24.493377 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f0361145-6ecf-43c1-8c43-21880d1369cf tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:24.501624 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f0361145-6ecf-43c1-8c43-21880d1369cf tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1721 microversion: 2.1 time: 0.157265 Jul 25 23:08:24.502197 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 279/557] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:24 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:24.837901 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-d9fa0609-aeaa-40f5-a3c9-f8dcddf7cb31 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:24.838508 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-d9fa0609-aeaa-40f5-a3c9-f8dcddf7cb31 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fd5cd68d-b7c2-48c3-813a-337a6ba8472f] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:24.845456 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d9fa0609-aeaa-40f5-a3c9-f8dcddf7cb31 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:24.845905 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d9fa0609-aeaa-40f5-a3c9-f8dcddf7cb31 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:24.846677 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d9fa0609-aeaa-40f5-a3c9-f8dcddf7cb31 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:24.847160 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d9fa0609-aeaa-40f5-a3c9-f8dcddf7cb31 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:24.985285 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-d9fa0609-aeaa-40f5-a3c9-f8dcddf7cb31 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:24.993585 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-d9fa0609-aeaa-40f5-a3c9-f8dcddf7cb31 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f" status: 200 len: 1319 microversion: 2.1 time: 0.159472 Jul 25 23:08:24.994151 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 279/558] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:24 2022] GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:25.524644 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-45e77472-1119-4c2c-960a-549db51b6f00 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:25.525202 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-45e77472-1119-4c2c-960a-549db51b6f00 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:25.531822 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-45e77472-1119-4c2c-960a-549db51b6f00 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:25.532262 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-45e77472-1119-4c2c-960a-549db51b6f00 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:25.533014 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-45e77472-1119-4c2c-960a-549db51b6f00 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:25.533466 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-45e77472-1119-4c2c-960a-549db51b6f00 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:25.671693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-45e77472-1119-4c2c-960a-549db51b6f00 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:25.680360 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-45e77472-1119-4c2c-960a-549db51b6f00 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1721 microversion: 2.1 time: 0.160012 Jul 25 23:08:25.680940 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 280/559] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:25 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:26.014567 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-0af0b029-6c28-4243-8eaf-85a56488898f tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:26.015178 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-0af0b029-6c28-4243-8eaf-85a56488898f tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fd5cd68d-b7c2-48c3-813a-337a6ba8472f] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:26.021892 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0af0b029-6c28-4243-8eaf-85a56488898f tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:26.022327 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0af0b029-6c28-4243-8eaf-85a56488898f tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:26.023354 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0af0b029-6c28-4243-8eaf-85a56488898f tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:26.023782 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0af0b029-6c28-4243-8eaf-85a56488898f tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:26.158208 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-0af0b029-6c28-4243-8eaf-85a56488898f tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:26.165883 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-0af0b029-6c28-4243-8eaf-85a56488898f tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f" status: 200 len: 1319 microversion: 2.1 time: 0.155115 Jul 25 23:08:26.169227 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 280/560] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:26 2022] GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:08:26.702382 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a122df59-4612-435f-8dc9-e8c3da3adebd tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:26.702915 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a122df59-4612-435f-8dc9-e8c3da3adebd tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:26.705446 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=2 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:08:26.711149 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a122df59-4612-435f-8dc9-e8c3da3adebd tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:26.711604 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a122df59-4612-435f-8dc9-e8c3da3adebd tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:26.712396 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a122df59-4612-435f-8dc9-e8c3da3adebd tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:26.712832 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a122df59-4612-435f-8dc9-e8c3da3adebd tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:26.848665 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a122df59-4612-435f-8dc9-e8c3da3adebd tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:26.857627 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a122df59-4612-435f-8dc9-e8c3da3adebd tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1721 microversion: 2.1 time: 0.159158 Jul 25 23:08:26.858202 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 281/561] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:26 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:27.186917 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-d59282e1-985d-4048-bbe2-245416cd676f tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:27.187529 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-d59282e1-985d-4048-bbe2-245416cd676f tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fd5cd68d-b7c2-48c3-813a-337a6ba8472f] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:27.189511 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell0:SELECT=2 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:08:27.190170 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell0:SELECT=6 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:08:27.195448 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d59282e1-985d-4048-bbe2-245416cd676f tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:27.195889 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d59282e1-985d-4048-bbe2-245416cd676f tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:27.196642 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d59282e1-985d-4048-bbe2-245416cd676f tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:27.197074 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d59282e1-985d-4048-bbe2-245416cd676f tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:27.333314 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-d59282e1-985d-4048-bbe2-245416cd676f tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:27.340786 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-d59282e1-985d-4048-bbe2-245416cd676f tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f" status: 200 len: 1319 microversion: 2.1 time: 0.157736 Jul 25 23:08:27.341373 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 281/562] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:27 2022] GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:27.873672 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-5cb88834-b556-4888-bcd5-d35ba24dfba1 req-80fed538-1d3f-41da-b2f2-0549ec50af1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd5cd68d-b7c2-48c3-813a-337a6ba8472f", "name": "network-vif-plugged", "status": "completed", "tag": "ef2b1954-33ca-4375-97d3-e90ba0e025ed"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:08:27.881879 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-02ea24d0-5205-41e3-a2ec-751f39a94a52 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:27.882459 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-02ea24d0-5205-41e3-a2ec-751f39a94a52 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:27.885205 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-5cb88834-b556-4888-bcd5-d35ba24dfba1 req-80fed538-1d3f-41da-b2f2-0549ec50af1e service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:27.885648 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-5cb88834-b556-4888-bcd5-d35ba24dfba1 req-80fed538-1d3f-41da-b2f2-0549ec50af1e service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:27.888792 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-02ea24d0-5205-41e3-a2ec-751f39a94a52 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:27.889411 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-02ea24d0-5205-41e3-a2ec-751f39a94a52 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:27.890264 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-02ea24d0-5205-41e3-a2ec-751f39a94a52 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:27.890699 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-02ea24d0-5205-41e3-a2ec-751f39a94a52 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:27.897814 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-5cb88834-b556-4888-bcd5-d35ba24dfba1 req-80fed538-1d3f-41da-b2f2-0549ec50af1e service nova] Creating event network-vif-plugged:ef2b1954-33ca-4375-97d3-e90ba0e025ed for instance fd5cd68d-b7c2-48c3-813a-337a6ba8472f on hv-cinder-79760 Jul 25 23:08:27.903401 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-5cb88834-b556-4888-bcd5-d35ba24dfba1 req-80fed538-1d3f-41da-b2f2-0549ec50af1e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033619 Jul 25 23:08:27.904349 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 282/563] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:08:27.989787 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-48a0862f-f5b9-47cf-b2a6-1a2b215721af tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1487652867"}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:08:27.990494 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-48a0862f-f5b9-47cf-b2a6-1a2b215721af tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:27.997747 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-48a0862f-f5b9-47cf-b2a6-1a2b215721af tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:27.998078 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-48a0862f-f5b9-47cf-b2a6-1a2b215721af tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:27.998942 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-48a0862f-f5b9-47cf-b2a6-1a2b215721af tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:27.999386 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-48a0862f-f5b9-47cf-b2a6-1a2b215721af tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:28.031140 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-02ea24d0-5205-41e3-a2ec-751f39a94a52 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:28.041409 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-02ea24d0-5205-41e3-a2ec-751f39a94a52 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1727 microversion: 2.1 time: 0.164724 Jul 25 23:08:28.042635 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 282/564] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:27 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:28.067252 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-8970738b-c3b2-49bc-aa12-dc56b5fb03c2 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:28.067751 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-8970738b-c3b2-49bc-aa12-dc56b5fb03c2 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:28.074056 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8970738b-c3b2-49bc-aa12-dc56b5fb03c2 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:28.074503 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8970738b-c3b2-49bc-aa12-dc56b5fb03c2 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:28.075269 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8970738b-c3b2-49bc-aa12-dc56b5fb03c2 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:28.075735 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8970738b-c3b2-49bc-aa12-dc56b5fb03c2 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:28.178669 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.network.security_group_api [None req-48a0862f-f5b9-47cf-b2a6-1a2b215721af tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Removing security group 976cbece-de9d-4247-946f-7d78b3c0c6f5 from port 65c4e82d-ddb3-40b6-9509-99191d55da54 Jul 25 23:08:28.189207 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-8970738b-c3b2-49bc-aa12-dc56b5fb03c2 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.126003 Jul 25 23:08:28.190323 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 283/565] 10.222.0.55 () {58 vars in 1275 bytes} [Mon Jul 25 23:08:28 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:08:28.195787 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-b066da5f-e3ae-4cdd-a31a-6c0b537fd4d5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:28.196210 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-b066da5f-e3ae-4cdd-a31a-6c0b537fd4d5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:28.203014 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b066da5f-e3ae-4cdd-a31a-6c0b537fd4d5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:28.203457 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b066da5f-e3ae-4cdd-a31a-6c0b537fd4d5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:28.204371 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b066da5f-e3ae-4cdd-a31a-6c0b537fd4d5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:28.204802 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b066da5f-e3ae-4cdd-a31a-6c0b537fd4d5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:28.238562 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-b066da5f-e3ae-4cdd-a31a-6c0b537fd4d5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33/os-volume_attachments/d7a99b94-b7f9-4e98-9a3f-76cb66e0b1d7" status: 200 len: 194 microversion: 2.20 time: 0.045949 Jul 25 23:08:28.245008 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 284/566] 10.222.0.55 () {60 vars in 1454 bytes} [Mon Jul 25 23:08:28 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33/os-volume_attachments/d7a99b94-b7f9-4e98-9a3f-76cb66e0b1d7 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 23:08:28.312728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-2e3a6cc5-a1f4-4ce5-9839-89b80968a256 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:28.313673 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-2e3a6cc5-a1f4-4ce5-9839-89b80968a256 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:28.321540 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2e3a6cc5-a1f4-4ce5-9839-89b80968a256 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:28.321987 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2e3a6cc5-a1f4-4ce5-9839-89b80968a256 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:28.322753 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2e3a6cc5-a1f4-4ce5-9839-89b80968a256 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:28.323416 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2e3a6cc5-a1f4-4ce5-9839-89b80968a256 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:28.417379 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.objects.instance [None req-2e3a6cc5-a1f4-4ce5-9839-89b80968a256 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lazy-loading 'services' on Instance uuid e78f6354-b88d-45a6-817b-4ef206d07d33 {{(pid=118409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 23:08:28.653877 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-48a0862f-f5b9-47cf-b2a6-1a2b215721af tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "POST /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8/action" status: 202 len: 0 microversion: 2.1 time: 0.669525 Jul 25 23:08:28.654745 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 283/567] 10.222.0.55 () {60 vars in 1278 bytes} [Mon Jul 25 23:08:27 2022] POST /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8/action => generated 0 bytes in 671 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 23:08:28.661397 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e58dd562-b53f-4de2-8512-f5578c7dd741 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:28.662023 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e58dd562-b53f-4de2-8512-f5578c7dd741 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fd5cd68d-b7c2-48c3-813a-337a6ba8472f] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:28.684291 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e58dd562-b53f-4de2-8512-f5578c7dd741 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:28.685679 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e58dd562-b53f-4de2-8512-f5578c7dd741 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:28.686448 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-2e3a6cc5-a1f4-4ce5-9839-89b80968a256 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "DELETE /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33/os-volume_attachments/d7a99b94-b7f9-4e98-9a3f-76cb66e0b1d7" status: 202 len: 0 microversion: 2.20 time: 0.377442 Jul 25 23:08:28.689775 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e58dd562-b53f-4de2-8512-f5578c7dd741 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:28.689775 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e58dd562-b53f-4de2-8512-f5578c7dd741 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:28.689972 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 285/568] 10.222.0.55 () {60 vars in 1457 bytes} [Mon Jul 25 23:08:28 2022] DELETE /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33/os-volume_attachments/d7a99b94-b7f9-4e98-9a3f-76cb66e0b1d7 => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 23:08:28.701171 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-9a5ac952-bacf-4f01-b57f-855cd49177bf req-a8dbd904-e265-4457-a57c-877a61402631 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "231ce093-ad72-4ed1-b3aa-f4f87da18ed8", "tag": "65c4e82d-ddb3-40b6-9509-99191d55da54"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:08:28.725147 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-9a5ac952-bacf-4f01-b57f-855cd49177bf req-a8dbd904-e265-4457-a57c-877a61402631 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:28.725942 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-9a5ac952-bacf-4f01-b57f-855cd49177bf req-a8dbd904-e265-4457-a57c-877a61402631 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:28.763426 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-9a5ac952-bacf-4f01-b57f-855cd49177bf req-a8dbd904-e265-4457-a57c-877a61402631 service nova] Creating event network-changed:65c4e82d-ddb3-40b6-9509-99191d55da54 for instance 231ce093-ad72-4ed1-b3aa-f4f87da18ed8 on hv-cinder-79760 Jul 25 23:08:28.777069 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-9a5ac952-bacf-4f01-b57f-855cd49177bf req-a8dbd904-e265-4457-a57c-877a61402631 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083595 Jul 25 23:08:28.778594 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 286/569] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:08:28.788817 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-39d17d7e-0f3a-437e-9937-b0241a406c7d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:28.791987 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-39d17d7e-0f3a-437e-9937-b0241a406c7d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:28.816305 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-39d17d7e-0f3a-437e-9937-b0241a406c7d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:28.817308 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-39d17d7e-0f3a-437e-9937-b0241a406c7d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:28.818651 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-39d17d7e-0f3a-437e-9937-b0241a406c7d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:28.820861 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-39d17d7e-0f3a-437e-9937-b0241a406c7d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:28.866718 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:08:28.898521 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-39d17d7e-0f3a-437e-9937-b0241a406c7d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.117844 Jul 25 23:08:28.901667 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 287/570] 10.222.0.55 () {60 vars in 1343 bytes} [Mon Jul 25 23:08:28 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 23:08:28.985725 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e58dd562-b53f-4de2-8512-f5578c7dd741 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:28.994424 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e58dd562-b53f-4de2-8512-f5578c7dd741 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f" status: 200 len: 1319 microversion: 2.1 time: 0.338838 Jul 25 23:08:29.009889 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 284/571] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:28 2022] GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f => generated 1319 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:29.585146 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-3e1fea3a-e6d9-49e8-9de1-353b6544a6d0 req-3ceeade2-5b41-4cc7-9bb2-30369286f020 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b265736-7f3b-4414-a694-38120987bad8", "tag": "e1b7bf8a-034c-4009-9dae-e893018ee8ee"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:08:29.597567 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-3e1fea3a-e6d9-49e8-9de1-353b6544a6d0 req-3ceeade2-5b41-4cc7-9bb2-30369286f020 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:29.598556 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-3e1fea3a-e6d9-49e8-9de1-353b6544a6d0 req-3ceeade2-5b41-4cc7-9bb2-30369286f020 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:29.611012 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-3e1fea3a-e6d9-49e8-9de1-353b6544a6d0 req-3ceeade2-5b41-4cc7-9bb2-30369286f020 service nova] Creating event network-changed:e1b7bf8a-034c-4009-9dae-e893018ee8ee for instance 6b265736-7f3b-4414-a694-38120987bad8 on hv-cinder-79760 Jul 25 23:08:29.617083 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-3e1fea3a-e6d9-49e8-9de1-353b6544a6d0 req-3ceeade2-5b41-4cc7-9bb2-30369286f020 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036427 Jul 25 23:08:29.618136 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 288/572] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 23:08:29.911906 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d6cffa17-9a51-4d95-81ed-8e5cc6115930 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:29.914219 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-d6cffa17-9a51-4d95-81ed-8e5cc6115930 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:29.921690 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d6cffa17-9a51-4d95-81ed-8e5cc6115930 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:29.922991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d6cffa17-9a51-4d95-81ed-8e5cc6115930 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:29.922991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d6cffa17-9a51-4d95-81ed-8e5cc6115930 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:29.923344 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d6cffa17-9a51-4d95-81ed-8e5cc6115930 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:29.955256 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-d6cffa17-9a51-4d95-81ed-8e5cc6115930 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047861 Jul 25 23:08:29.955824 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 285/573] 10.222.0.55 () {60 vars in 1343 bytes} [Mon Jul 25 23:08:29 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 23:08:30.018289 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-b96e5a88-eee9-4377-9901-65842afffbde tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:30.018997 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-b96e5a88-eee9-4377-9901-65842afffbde tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fd5cd68d-b7c2-48c3-813a-337a6ba8472f] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:30.027133 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b96e5a88-eee9-4377-9901-65842afffbde tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:30.027588 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b96e5a88-eee9-4377-9901-65842afffbde tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:30.028380 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b96e5a88-eee9-4377-9901-65842afffbde tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:30.028817 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b96e5a88-eee9-4377-9901-65842afffbde tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:30.254959 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-b96e5a88-eee9-4377-9901-65842afffbde tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:30.263077 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-b96e5a88-eee9-4377-9901-65842afffbde tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f" status: 200 len: 1319 microversion: 2.1 time: 0.249661 Jul 25 23:08:30.263661 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 289/574] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:30 2022] GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:30.631609 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e0eba5e9-5a8c-4813-959e-9992bca40ccb tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:30.632853 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e0eba5e9-5a8c-4813-959e-9992bca40ccb tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:30.639974 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e0eba5e9-5a8c-4813-959e-9992bca40ccb tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:30.640422 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e0eba5e9-5a8c-4813-959e-9992bca40ccb tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:30.641519 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e0eba5e9-5a8c-4813-959e-9992bca40ccb tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:30.641957 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e0eba5e9-5a8c-4813-959e-9992bca40ccb tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:30.734979 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.objects.instance [None req-e0eba5e9-5a8c-4813-959e-9992bca40ccb tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lazy-loading 'services' on Instance uuid 231ce093-ad72-4ed1-b3aa-f4f87da18ed8 {{(pid=118410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 23:08:30.968236 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-2add01ae-28aa-43ce-ad8a-b26f797c8fa4 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:30.970524 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-2add01ae-28aa-43ce-ad8a-b26f797c8fa4 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:30.977088 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2add01ae-28aa-43ce-ad8a-b26f797c8fa4 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:30.977598 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2add01ae-28aa-43ce-ad8a-b26f797c8fa4 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:30.978374 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2add01ae-28aa-43ce-ad8a-b26f797c8fa4 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:30.978838 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2add01ae-28aa-43ce-ad8a-b26f797c8fa4 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:31.020302 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-2add01ae-28aa-43ce-ad8a-b26f797c8fa4 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055945 Jul 25 23:08:31.026401 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 290/575] 10.222.0.55 () {60 vars in 1343 bytes} [Mon Jul 25 23:08:30 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 23:08:31.058306 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e0eba5e9-5a8c-4813-959e-9992bca40ccb tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "DELETE /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8/os-volume_attachments/1ea13cfd-a984-4e7f-99e5-1c9c6a7b9677" status: 202 len: 0 microversion: 2.1 time: 0.431587 Jul 25 23:08:31.059283 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 286/576] 10.222.0.55 () {58 vars in 1416 bytes} [Mon Jul 25 23:08:30 2022] DELETE /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8/os-volume_attachments/1ea13cfd-a984-4e7f-99e5-1c9c6a7b9677 => generated 0 bytes in 433 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 23:08:31.069893 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-fdec67fc-188e-4e7a-b163-a07251f82c67 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:31.072307 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-fdec67fc-188e-4e7a-b163-a07251f82c67 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:31.078705 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-fdec67fc-188e-4e7a-b163-a07251f82c67 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:31.083707 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-fdec67fc-188e-4e7a-b163-a07251f82c67 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:31.094330 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-fdec67fc-188e-4e7a-b163-a07251f82c67 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:31.094972 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-fdec67fc-188e-4e7a-b163-a07251f82c67 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:31.137493 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-fdec67fc-188e-4e7a-b163-a07251f82c67 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073434 Jul 25 23:08:31.138406 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 291/577] 10.222.0.55 () {58 vars in 1302 bytes} [Mon Jul 25 23:08:31 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:08:31.287315 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-37641011-aa13-4c13-b75e-8f1f633330f8 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:31.288515 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-37641011-aa13-4c13-b75e-8f1f633330f8 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fd5cd68d-b7c2-48c3-813a-337a6ba8472f] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:31.297581 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-37641011-aa13-4c13-b75e-8f1f633330f8 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:31.299534 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-37641011-aa13-4c13-b75e-8f1f633330f8 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:31.300925 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-37641011-aa13-4c13-b75e-8f1f633330f8 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:31.301648 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-37641011-aa13-4c13-b75e-8f1f633330f8 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:31.527879 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-37641011-aa13-4c13-b75e-8f1f633330f8 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:31.537210 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-37641011-aa13-4c13-b75e-8f1f633330f8 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f" status: 200 len: 1508 microversion: 2.1 time: 0.255410 Jul 25 23:08:31.540801 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 287/578] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:31 2022] GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f => generated 1508 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:31.558062 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-0ac918e3-7a28-459a-8c0e-ba67143fe913 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd5fa439-64d0-4d72-9841-be0ce18001ab", "device": "/dev/sdb"}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:08:31.560996 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-0ac918e3-7a28-459a-8c0e-ba67143fe913 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fd5cd68d-b7c2-48c3-813a-337a6ba8472f] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:31.567980 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0ac918e3-7a28-459a-8c0e-ba67143fe913 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:31.568426 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0ac918e3-7a28-459a-8c0e-ba67143fe913 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:31.569232 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0ac918e3-7a28-459a-8c0e-ba67143fe913 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:31.569726 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0ac918e3-7a28-459a-8c0e-ba67143fe913 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:31.635698 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-66e83a24-b550-4b37-95df-3f6055f1f478 req-edc44699-a6ae-458e-8e9c-4cbae2d716d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b265736-7f3b-4414-a694-38120987bad8", "tag": "e1b7bf8a-034c-4009-9dae-e893018ee8ee"}, {"name": "network-changed", "server_uuid": "231ce093-ad72-4ed1-b3aa-f4f87da18ed8", "tag": "65c4e82d-ddb3-40b6-9509-99191d55da54"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:08:31.646837 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-66e83a24-b550-4b37-95df-3f6055f1f478 req-edc44699-a6ae-458e-8e9c-4cbae2d716d5 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:31.647199 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-66e83a24-b550-4b37-95df-3f6055f1f478 req-edc44699-a6ae-458e-8e9c-4cbae2d716d5 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:31.660438 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-66e83a24-b550-4b37-95df-3f6055f1f478 req-edc44699-a6ae-458e-8e9c-4cbae2d716d5 service nova] Creating event network-changed:e1b7bf8a-034c-4009-9dae-e893018ee8ee for instance 6b265736-7f3b-4414-a694-38120987bad8 on hv-cinder-79760 Jul 25 23:08:31.660943 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-66e83a24-b550-4b37-95df-3f6055f1f478 req-edc44699-a6ae-458e-8e9c-4cbae2d716d5 service nova] Creating event network-changed:65c4e82d-ddb3-40b6-9509-99191d55da54 for instance 231ce093-ad72-4ed1-b3aa-f4f87da18ed8 on hv-cinder-79760 Jul 25 23:08:31.667153 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-66e83a24-b550-4b37-95df-3f6055f1f478 req-edc44699-a6ae-458e-8e9c-4cbae2d716d5 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035103 Jul 25 23:08:31.667737 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 288/579] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 23:08:32.036331 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-32462c90-78ef-4b8e-aea7-c23dd594dc1d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:32.038635 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-32462c90-78ef-4b8e-aea7-c23dd594dc1d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:32.045001 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-32462c90-78ef-4b8e-aea7-c23dd594dc1d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:32.045512 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-32462c90-78ef-4b8e-aea7-c23dd594dc1d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:32.046283 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-32462c90-78ef-4b8e-aea7-c23dd594dc1d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:32.046711 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-32462c90-78ef-4b8e-aea7-c23dd594dc1d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:32.077978 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-32462c90-78ef-4b8e-aea7-c23dd594dc1d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047011 Jul 25 23:08:32.078865 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 289/580] 10.222.0.55 () {60 vars in 1343 bytes} [Mon Jul 25 23:08:32 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:08:32.149659 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-46ba44bd-aef0-4ae7-a986-18f7e626fe68 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:32.150191 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-46ba44bd-aef0-4ae7-a986-18f7e626fe68 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:32.156249 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-46ba44bd-aef0-4ae7-a986-18f7e626fe68 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:32.156692 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-46ba44bd-aef0-4ae7-a986-18f7e626fe68 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:32.157660 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-46ba44bd-aef0-4ae7-a986-18f7e626fe68 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:32.158280 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-46ba44bd-aef0-4ae7-a986-18f7e626fe68 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:32.185242 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-46ba44bd-aef0-4ae7-a986-18f7e626fe68 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Going to try to terminate instance {{(pid=118410) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 23:08:32.220417 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:08:32.396237 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=70 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:08:32.486553 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-46ba44bd-aef0-4ae7-a986-18f7e626fe68 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "DELETE /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 204 len: 0 microversion: 2.20 time: 0.340914 Jul 25 23:08:32.487164 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 290/581] 10.222.0.55 () {60 vars in 1280 bytes} [Mon Jul 25 23:08:32 2022] DELETE /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 25 23:08:32.492301 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b8fc9b10-db26-476e-8cec-ff58ea07d4a6 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:32.494656 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b8fc9b10-db26-476e-8cec-ff58ea07d4a6 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:32.500711 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b8fc9b10-db26-476e-8cec-ff58ea07d4a6 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:32.501188 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b8fc9b10-db26-476e-8cec-ff58ea07d4a6 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:32.502008 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b8fc9b10-db26-476e-8cec-ff58ea07d4a6 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:32.502442 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b8fc9b10-db26-476e-8cec-ff58ea07d4a6 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:32.536755 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b8fc9b10-db26-476e-8cec-ff58ea07d4a6 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048346 Jul 25 23:08:32.537382 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 291/582] 10.222.0.55 () {58 vars in 1302 bytes} [Mon Jul 25 23:08:32 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:08:32.541824 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-680d8445-414a-470a-a8c8-a269a09f00a9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:32.542425 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-680d8445-414a-470a-a8c8-a269a09f00a9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:32.548344 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-680d8445-414a-470a-a8c8-a269a09f00a9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:32.548802 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-680d8445-414a-470a-a8c8-a269a09f00a9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:32.549604 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-680d8445-414a-470a-a8c8-a269a09f00a9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:32.550104 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-680d8445-414a-470a-a8c8-a269a09f00a9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:32.687996 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-680d8445-414a-470a-a8c8-a269a09f00a9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:32.696393 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-680d8445-414a-470a-a8c8-a269a09f00a9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:32.697902 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-680d8445-414a-470a-a8c8-a269a09f00a9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:32.699035 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-680d8445-414a-470a-a8c8-a269a09f00a9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1724 microversion: 2.20 time: 0.160790 Jul 25 23:08:32.699592 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 292/583] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:08:32 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:08:32.730736 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-0ac918e3-7a28-459a-8c0e-ba67143fe913 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "POST /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.176474 Jul 25 23:08:32.731346 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 292/584] 10.222.0.55 () {60 vars in 1323 bytes} [Mon Jul 25 23:08:31 2022] POST /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f/os-volume_attachments => generated 194 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:08:33.549093 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-cb2db2f5-33ac-4dda-b06f-15e4c509ab9d tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:33.552138 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-cb2db2f5-33ac-4dda-b06f-15e4c509ab9d tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:33.558749 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cb2db2f5-33ac-4dda-b06f-15e4c509ab9d tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:33.559200 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cb2db2f5-33ac-4dda-b06f-15e4c509ab9d tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:33.559965 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cb2db2f5-33ac-4dda-b06f-15e4c509ab9d tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:33.560396 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cb2db2f5-33ac-4dda-b06f-15e4c509ab9d tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:33.589436 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-cb2db2f5-33ac-4dda-b06f-15e4c509ab9d tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044200 Jul 25 23:08:33.589998 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 293/585] 10.222.0.55 () {58 vars in 1302 bytes} [Mon Jul 25 23:08:33 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:08:33.722517 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-657b0ffc-64ee-4e1b-9eea-57d9287d8903 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:33.723254 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-657b0ffc-64ee-4e1b-9eea-57d9287d8903 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:33.729632 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-657b0ffc-64ee-4e1b-9eea-57d9287d8903 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:33.730071 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-657b0ffc-64ee-4e1b-9eea-57d9287d8903 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:33.730830 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-657b0ffc-64ee-4e1b-9eea-57d9287d8903 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:33.731362 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-657b0ffc-64ee-4e1b-9eea-57d9287d8903 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:33.865929 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-657b0ffc-64ee-4e1b-9eea-57d9287d8903 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:33.874306 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-657b0ffc-64ee-4e1b-9eea-57d9287d8903 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:33.875821 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-657b0ffc-64ee-4e1b-9eea-57d9287d8903 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:33.876966 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-657b0ffc-64ee-4e1b-9eea-57d9287d8903 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1724 microversion: 2.20 time: 0.159289 Jul 25 23:08:33.877553 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 293/586] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:08:33 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:08:34.601847 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-406df614-8fe6-40f9-b0db-4c7bee60256d tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:34.604423 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-406df614-8fe6-40f9-b0db-4c7bee60256d tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:34.611324 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-406df614-8fe6-40f9-b0db-4c7bee60256d tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:34.612095 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-406df614-8fe6-40f9-b0db-4c7bee60256d tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:34.613890 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-406df614-8fe6-40f9-b0db-4c7bee60256d tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:34.614534 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-406df614-8fe6-40f9-b0db-4c7bee60256d tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:34.645689 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-406df614-8fe6-40f9-b0db-4c7bee60256d tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047649 Jul 25 23:08:34.651898 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 294/587] 10.222.0.55 () {58 vars in 1302 bytes} [Mon Jul 25 23:08:34 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 23:08:34.656990 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-3275723a-9983-46a4-9c43-c48e378ef117 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:34.657518 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-3275723a-9983-46a4-9c43-c48e378ef117 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:34.664624 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3275723a-9983-46a4-9c43-c48e378ef117 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:34.665078 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3275723a-9983-46a4-9c43-c48e378ef117 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:34.666046 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3275723a-9983-46a4-9c43-c48e378ef117 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:34.666640 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3275723a-9983-46a4-9c43-c48e378ef117 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:34.750458 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.wsgi [None req-3275723a-9983-46a4-9c43-c48e378ef117 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] HTTP exception thrown: Instance 231ce093-ad72-4ed1-b3aa-f4f87da18ed8 is not attached to volume 1ea13cfd-a984-4e7f-99e5-1c9c6a7b9677 Jul 25 23:08:34.753630 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-3275723a-9983-46a4-9c43-c48e378ef117 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Request method failure captured: Jul 25 23:08:34.753630 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: request: DELETE /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8/os-volume_attachments/1ea13cfd-a984-4e7f-99e5-1c9c6a7b9677 HTTP/1.1 Jul 25 23:08:34.753630 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept: application/json Jul 25 23:08:34.753630 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept-Encoding: identity Jul 25 23:08:34.753630 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Connection: close Jul 25 23:08:34.753630 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Length: 0 Jul 25 23:08:34.753630 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Type: application/json Jul 25 23:08:34.753630 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Host: 10.222.0.55 Jul 25 23:08:34.753630 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Openstack-System-Scope: None Jul 25 23:08:34.753630 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: User-Agent: python-urllib3/1.26.10 Jul 25 23:08:34.753630 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Auth-Token: gAAAAABi3yGqIpRWxER2bF6DqyOaDJCU6ErpH_ER5XUsWjaypUT_--wBM62D4pDgq2scFVN_627F6ufkr_EM5MPcSJTNU0K7oQxDxSfoYt2udKdfgXvhmcJZVdPdtgO32uIj03pTZKW3UdCcHmg1c5yeRm6XwQiQjJXU73MzQH8mY5xhx7dS2wU Jul 25 23:08:34.753630 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Id: None Jul 25 23:08:34.753630 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Name: None Jul 25 23:08:34.753630 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Identity-Status: Confirmed Jul 25 23:08:34.753630 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Is-Admin-Project: True Jul 25 23:08:34.753630 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Id: default Jul 25 23:08:34.753630 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Name: Default Jul 25 23:08:34.753630 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Id: d0af93f7c6b54114b0e1b5c32e3bf623 Jul 25 23:08:34.753630 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Name: tempest-TestMinimumBasicScenario-174985237 Jul 25 23:08:34.753630 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Role: reader,member Jul 25 23:08:34.753630 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Roles: reader,member Jul 25 23:08:34.756260 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d0af93f7c6b54114b0e1b5c32e3bf623"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d0af93f7c6b54114b0e1b5c32e3bf623"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d0af93f7c6b54114b0e1b5c32e3bf623", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d0af93f7c6b54114b0e1b5c32e3bf623"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:08:34.756260 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant: tempest-TestMinimumBasicScenario-174985237 Jul 25 23:08:34.756260 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Id: d0af93f7c6b54114b0e1b5c32e3bf623 Jul 25 23:08:34.756260 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Name: tempest-TestMinimumBasicScenario-174985237 Jul 25 23:08:34.756260 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User: tempest-TestMinimumBasicScenario-174985237-project Jul 25 23:08:34.756260 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Id: default Jul 25 23:08:34.756260 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Name: Default Jul 25 23:08:34.756260 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Id: 2c4c72b9c83a4967b57b6633f9934dd4 Jul 25 23:08:34.756260 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Name: tempest-TestMinimumBasicScenario-174985237-project Jul 25 23:08:34.756260 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: method: > Jul 25 23:08:34.756260 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: exception: Instance 231ce093-ad72-4ed1-b3aa-f4f87da18ed8 is not attached to volume 1ea13cfd-a984-4e7f-99e5-1c9c6a7b9677 Jul 25 23:08:34.757152 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: action_args: {'server_id': '231ce093-ad72-4ed1-b3aa-f4f87da18ed8', 'id': '1ea13cfd-a984-4e7f-99e5-1c9c6a7b9677'} Jul 25 23:08:34.757152 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:08:34.757152 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:08:34.757152 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 25 23:08:34.757152 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 25 23:08:34.757152 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 25 23:08:34.757152 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 25 23:08:34.757152 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 25 23:08:34.757152 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 25 23:08:34.757152 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1ea13cfd-a984-4e7f-99e5-1c9c6a7b9677. Jul 25 23:08:34.757152 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:08:34.757152 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:08:34.757152 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:08:34.757152 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:08:34.757152 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:08:34.757152 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:08:34.757152 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:08:34.757152 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:08:34.757152 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:08:34.758683 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:08:34.758683 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 25 23:08:34.758683 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 25 23:08:34.758683 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 231ce093-ad72-4ed1-b3aa-f4f87da18ed8 is not attached to volume 1ea13cfd-a984-4e7f-99e5-1c9c6a7b9677 Jul 25 23:08:34.758683 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:08:34.758683 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:08:34.758683 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:08:34.758683 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:08:34.758683 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:08:34.758683 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:08:34.758683 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:08:34.758683 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:08:34.758683 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 231ce093-ad72-4ed1-b3aa-f4f87da18ed8 is not attached to volume 1ea13cfd-a984-4e7f-99e5-1c9c6a7b9677 Jul 25 23:08:34.758683 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:08:34.758683 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-3275723a-9983-46a4-9c43-c48e378ef117 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Returning 404 to user: Instance 231ce093-ad72-4ed1-b3aa-f4f87da18ed8 is not attached to volume 1ea13cfd-a984-4e7f-99e5-1c9c6a7b9677 {{(pid=118409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:08:34.760291 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-3275723a-9983-46a4-9c43-c48e378ef117 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "DELETE /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8/os-volume_attachments/1ea13cfd-a984-4e7f-99e5-1c9c6a7b9677" status: 404 len: 154 microversion: 2.1 time: 0.102663 Jul 25 23:08:34.760291 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 294/588] 10.222.0.55 () {58 vars in 1416 bytes} [Mon Jul 25 23:08:34 2022] DELETE /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8/os-volume_attachments/1ea13cfd-a984-4e7f-99e5-1c9c6a7b9677 => generated 154 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:08:34.902467 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f5fd8867-f1cd-483c-98dd-8057a5b06a1d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:34.903062 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f5fd8867-f1cd-483c-98dd-8057a5b06a1d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:34.909113 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f5fd8867-f1cd-483c-98dd-8057a5b06a1d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:34.910129 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f5fd8867-f1cd-483c-98dd-8057a5b06a1d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:34.910909 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f5fd8867-f1cd-483c-98dd-8057a5b06a1d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:34.911327 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f5fd8867-f1cd-483c-98dd-8057a5b06a1d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:35.071994 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f5fd8867-f1cd-483c-98dd-8057a5b06a1d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:35.078906 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f5fd8867-f1cd-483c-98dd-8057a5b06a1d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:35.080427 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f5fd8867-f1cd-483c-98dd-8057a5b06a1d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:35.082487 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f5fd8867-f1cd-483c-98dd-8057a5b06a1d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1724 microversion: 2.20 time: 0.184282 Jul 25 23:08:35.083062 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 295/589] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:08:34 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:08:35.369673 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-8b0806f5-de2a-404a-b230-f084fd97a3e3 req-b0e901ee-acc7-45a6-a535-e58a1b1f9d10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e78f6354-b88d-45a6-817b-4ef206d07d33", "name": "network-vif-deleted", "tag": "b7e5b654-c700-4c79-966e-9953941ea57a"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:08:35.387509 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-8b0806f5-de2a-404a-b230-f084fd97a3e3 req-b0e901ee-acc7-45a6-a535-e58a1b1f9d10 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:35.387992 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-8b0806f5-de2a-404a-b230-f084fd97a3e3 req-b0e901ee-acc7-45a6-a535-e58a1b1f9d10 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:35.401702 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-8b0806f5-de2a-404a-b230-f084fd97a3e3 req-b0e901ee-acc7-45a6-a535-e58a1b1f9d10 service nova] Creating event network-vif-deleted:b7e5b654-c700-4c79-966e-9953941ea57a for instance e78f6354-b88d-45a6-817b-4ef206d07d33 on hv-cinder-79760 Jul 25 23:08:35.407445 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-8b0806f5-de2a-404a-b230-f084fd97a3e3 req-b0e901ee-acc7-45a6-a535-e58a1b1f9d10 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041582 Jul 25 23:08:35.408041 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 295/590] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:08:36.108732 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e0bc9878-30d2-4d69-80f7-26b95a3cc8ce tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:36.109176 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e0bc9878-30d2-4d69-80f7-26b95a3cc8ce tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:36.121280 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e0bc9878-30d2-4d69-80f7-26b95a3cc8ce tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:36.121725 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e0bc9878-30d2-4d69-80f7-26b95a3cc8ce tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:36.122523 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e0bc9878-30d2-4d69-80f7-26b95a3cc8ce tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:36.122941 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e0bc9878-30d2-4d69-80f7-26b95a3cc8ce tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:36.165756 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e0bc9878-30d2-4d69-80f7-26b95a3cc8ce tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:36.166214 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e0bc9878-30d2-4d69-80f7-26b95a3cc8ce tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:36.166675 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.objects.instance [None req-e0bc9878-30d2-4d69-80f7-26b95a3cc8ce tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lazy-loading 'fault' on Instance uuid e78f6354-b88d-45a6-817b-4ef206d07d33 {{(pid=118410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 23:08:36.218970 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-41671a72-41fc-4ffa-b186-ab736e7368b7 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:36.219613 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-41671a72-41fc-4ffa-b186-ab736e7368b7 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:36.226378 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e0bc9878-30d2-4d69-80f7-26b95a3cc8ce tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:36.227286 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:08:36.229456 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-41671a72-41fc-4ffa-b186-ab736e7368b7 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:36.229959 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-41671a72-41fc-4ffa-b186-ab736e7368b7 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:36.230986 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-41671a72-41fc-4ffa-b186-ab736e7368b7 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:36.231480 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-41671a72-41fc-4ffa-b186-ab736e7368b7 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:36.235364 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e0bc9878-30d2-4d69-80f7-26b95a3cc8ce tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:36.238813 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e0bc9878-30d2-4d69-80f7-26b95a3cc8ce tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:36.240306 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e0bc9878-30d2-4d69-80f7-26b95a3cc8ce tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 200 len: 1371 microversion: 2.20 time: 0.136180 Jul 25 23:08:36.241041 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 296/591] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:08:36 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 1371 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:08:36.272343 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-41671a72-41fc-4ffa-b186-ab736e7368b7 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Going to try to terminate instance {{(pid=118409) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 23:08:36.595365 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-41671a72-41fc-4ffa-b186-ab736e7368b7 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "DELETE /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 204 len: 0 microversion: 2.1 time: 0.382235 Jul 25 23:08:36.597834 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 296/592] 10.222.0.55 () {58 vars in 1239 bytes} [Mon Jul 25 23:08:36 2022] DELETE /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 23:08:36.606100 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f6c871aa-451c-4fa5-888d-2cbd80f13c0f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:36.606709 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f6c871aa-451c-4fa5-888d-2cbd80f13c0f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:36.613453 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f6c871aa-451c-4fa5-888d-2cbd80f13c0f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:36.613901 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f6c871aa-451c-4fa5-888d-2cbd80f13c0f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:36.614676 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f6c871aa-451c-4fa5-888d-2cbd80f13c0f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:36.615114 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f6c871aa-451c-4fa5-888d-2cbd80f13c0f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:36.749922 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f6c871aa-451c-4fa5-888d-2cbd80f13c0f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:36.758664 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f6c871aa-451c-4fa5-888d-2cbd80f13c0f tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1553 microversion: 2.1 time: 0.156373 Jul 25 23:08:36.759222 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 297/593] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:36 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:08:37.271464 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-32ffee0e-b979-45ba-ba98-7d38d87c7f81 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:37.272163 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-32ffee0e-b979-45ba-ba98-7d38d87c7f81 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:37.292954 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-32ffee0e-b979-45ba-ba98-7d38d87c7f81 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:37.294441 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-32ffee0e-b979-45ba-ba98-7d38d87c7f81 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:37.295365 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-32ffee0e-b979-45ba-ba98-7d38d87c7f81 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:37.295811 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-32ffee0e-b979-45ba-ba98-7d38d87c7f81 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:37.311902 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.wsgi [None req-32ffee0e-b979-45ba-ba98-7d38d87c7f81 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] HTTP exception thrown: Instance e78f6354-b88d-45a6-817b-4ef206d07d33 could not be found. Jul 25 23:08:37.312728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-32ffee0e-b979-45ba-ba98-7d38d87c7f81 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Request method failure captured: Jul 25 23:08:37.312728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: request: GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 HTTP/1.1 Jul 25 23:08:37.312728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept: application/json Jul 25 23:08:37.312728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept-Encoding: identity Jul 25 23:08:37.312728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Connection: close Jul 25 23:08:37.312728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Length: 0 Jul 25 23:08:37.312728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Type: application/json Jul 25 23:08:37.312728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Host: 10.222.0.55 Jul 25 23:08:37.312728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Openstack-System-Scope: None Jul 25 23:08:37.312728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: User-Agent: python-urllib3/1.26.10 Jul 25 23:08:37.312728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Auth-Token: gAAAAABi3yFo2oTM5L4NBrfb4jUXltmZfGsPYH9vcd3JJO5drEnrQWguvjzFRHQ7UAOmAzMrpXBLzLuc0B0_xLvtE6w0fH2UiGwmWBDnd0_Gx5CPktIzwcoWl3s4Aj8fpHfpXij2hITgR13pVXdrLCLI7L9z64TMoTPPRIwJWMUQiSIFvsS23Bs Jul 25 23:08:37.312728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Id: None Jul 25 23:08:37.312728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Name: None Jul 25 23:08:37.312728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Identity-Status: Confirmed Jul 25 23:08:37.312728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Is-Admin-Project: True Jul 25 23:08:37.312728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 23:08:37.312728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Id: default Jul 25 23:08:37.312728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Name: Default Jul 25 23:08:37.312728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Id: 16a417bb74d445f7b2240ccb27061f05 Jul 25 23:08:37.312728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-208491806 Jul 25 23:08:37.312728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Role: reader,member Jul 25 23:08:37.312728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Roles: reader,member Jul 25 23:08:37.314398 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/16a417bb74d445f7b2240ccb27061f05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/16a417bb74d445f7b2240ccb27061f05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_16a417bb74d445f7b2240ccb27061f05", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/16a417bb74d445f7b2240ccb27061f05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:08:37.314398 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant: tempest-AttachVolumeShelveTestJSON-208491806 Jul 25 23:08:37.314398 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Id: 16a417bb74d445f7b2240ccb27061f05 Jul 25 23:08:37.314398 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-208491806 Jul 25 23:08:37.314398 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User: tempest-AttachVolumeShelveTestJSON-208491806-project Jul 25 23:08:37.314398 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Id: default Jul 25 23:08:37.314398 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Name: Default Jul 25 23:08:37.314398 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Id: fbc4fc1f207c4726b9c05b6b338f0e9c Jul 25 23:08:37.314398 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Name: tempest-AttachVolumeShelveTestJSON-208491806-project Jul 25 23:08:37.314398 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: method: > Jul 25 23:08:37.314398 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: exception: Instance e78f6354-b88d-45a6-817b-4ef206d07d33 could not be found. Jul 25 23:08:37.314398 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: action_args: {'id': 'e78f6354-b88d-45a6-817b-4ef206d07d33'} Jul 25 23:08:37.316366 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:08:37.316366 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:08:37.316366 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:08:37.316366 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:08:37.316366 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:08:37.316366 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:08:37.316366 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:08:37.316366 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:08:37.316366 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:08:37.316366 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:08:37.316366 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e78f6354-b88d-45a6-817b-4ef206d07d33 could not be found. Jul 25 23:08:37.316366 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:08:37.316366 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:08:37.316366 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:08:37.316366 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:08:37.316366 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:08:37.316366 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:08:37.316366 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:08:37.316366 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:08:37.316366 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:08:37.317782 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:08:37.317782 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 23:08:37.317782 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 23:08:37.317782 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:08:37.317782 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:08:37.317782 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:08:37.317782 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:08:37.317782 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e78f6354-b88d-45a6-817b-4ef206d07d33 could not be found. Jul 25 23:08:37.317782 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:08:37.317782 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:08:37.317782 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:08:37.317782 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:08:37.317782 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:08:37.317782 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:08:37.317782 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:08:37.317782 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:08:37.317782 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e78f6354-b88d-45a6-817b-4ef206d07d33 could not be found. Jul 25 23:08:37.317782 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:08:37.318871 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-32ffee0e-b979-45ba-ba98-7d38d87c7f81 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Returning 404 to user: Instance e78f6354-b88d-45a6-817b-4ef206d07d33 could not be found. {{(pid=118409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:08:37.318871 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-32ffee0e-b979-45ba-ba98-7d38d87c7f81 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 404 len: 111 microversion: 2.20 time: 0.048218 Jul 25 23:08:37.318871 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 297/594] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:08:37 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 23:08:37.324423 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f4e74657-0176-47ea-ae4b-dae54b762f18 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '.version_select at 0x7f6226d405e0>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:37.448276 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f4e74657-0176-47ea-ae4b-dae54b762f18 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-488966017" status: 204 len: 0 microversion: 2.20 time: 0.127740 Jul 25 23:08:37.448869 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 298/595] 10.222.0.55 () {60 vars in 1259 bytes} [Mon Jul 25 23:08:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-488966017 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 23:08:37.779769 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-8cdabdf2-7123-4eb8-87b2-75635a871ef7 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:37.780370 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-8cdabdf2-7123-4eb8-87b2-75635a871ef7 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:37.787322 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8cdabdf2-7123-4eb8-87b2-75635a871ef7 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:37.787765 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8cdabdf2-7123-4eb8-87b2-75635a871ef7 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:37.788567 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8cdabdf2-7123-4eb8-87b2-75635a871ef7 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:37.789046 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8cdabdf2-7123-4eb8-87b2-75635a871ef7 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:38.173038 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-8cdabdf2-7123-4eb8-87b2-75635a871ef7 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:38.181956 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-8cdabdf2-7123-4eb8-87b2-75635a871ef7 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1553 microversion: 2.1 time: 0.405981 Jul 25 23:08:38.182461 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 298/596] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:37 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1553 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:38.573026 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f6d48374-c963-48ed-a37e-56b787f96bb9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Action: 'create', calling method: .version_select at 0x7f6226d22790>, body: {"keypair": {"name": "tempest-keypair-1693911719", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuVwLh3na+kKSEMvz90Exx3Rv5dSH/LuD5c70PQtMBJI9orpoC8uiUn1QIMxy8nGpdGpbwSwEuZgtFL/6K5I4DsECa0oUMs3CHBfL1fXHQsJ7xVLq441tJoiD51l2lkfA=="}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:08:38.588704 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-f6d48374-c963-48ed-a37e-56b787f96bb9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Getting quotas for project 16a417bb74d445f7b2240ccb27061f05. Resources: {'key_pairs'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 23:08:38.592470 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-f6d48374-c963-48ed-a37e-56b787f96bb9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Getting quotas for user fbc4fc1f207c4726b9c05b6b338f0e9c and project 16a417bb74d445f7b2240ccb27061f05. Resources: {'key_pairs'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 23:08:38.677820 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f6d48374-c963-48ed-a37e-56b787f96bb9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.109113 Jul 25 23:08:38.678716 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 299/597] 10.222.0.55 () {62 vars in 1200 bytes} [Mon Jul 25 23:08:38 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 111 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 25 23:08:39.206137 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-f624530e-96c9-4909-bddd-c8fc44954492 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:39.207440 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-f624530e-96c9-4909-bddd-c8fc44954492 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:39.214456 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f624530e-96c9-4909-bddd-c8fc44954492 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:39.215140 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f624530e-96c9-4909-bddd-c8fc44954492 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:39.216088 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f624530e-96c9-4909-bddd-c8fc44954492 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:39.216533 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f624530e-96c9-4909-bddd-c8fc44954492 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:39.234258 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-3ba248a8-4b5f-49e8-8fde-27c068d374f8 req-2b18baf7-71f0-4b5b-b6be-2c33d3e29f97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "231ce093-ad72-4ed1-b3aa-f4f87da18ed8", "name": "network-vif-deleted", "tag": "65c4e82d-ddb3-40b6-9509-99191d55da54"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:08:39.243689 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-3ba248a8-4b5f-49e8-8fde-27c068d374f8 req-2b18baf7-71f0-4b5b-b6be-2c33d3e29f97 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:39.244254 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-3ba248a8-4b5f-49e8-8fde-27c068d374f8 req-2b18baf7-71f0-4b5b-b6be-2c33d3e29f97 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:39.256536 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-3ba248a8-4b5f-49e8-8fde-27c068d374f8 req-2b18baf7-71f0-4b5b-b6be-2c33d3e29f97 service nova] Creating event network-vif-deleted:65c4e82d-ddb3-40b6-9509-99191d55da54 for instance 231ce093-ad72-4ed1-b3aa-f4f87da18ed8 on hv-cinder-79760 Jul 25 23:08:39.261649 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-3ba248a8-4b5f-49e8-8fde-27c068d374f8 req-2b18baf7-71f0-4b5b-b6be-2c33d3e29f97 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031074 Jul 25 23:08:39.262254 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 300/598] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:08:39.282153 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-f624530e-96c9-4909-bddd-c8fc44954492 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:39.290549 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-f624530e-96c9-4909-bddd-c8fc44954492 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1511 microversion: 2.1 time: 0.088488 Jul 25 23:08:39.291246 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 299/599] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:39 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1511 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:40.312865 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-28eeee31-0796-4f50-a8ff-aed089fd9efd tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:40.313602 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-28eeee31-0796-4f50-a8ff-aed089fd9efd tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:40.320269 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-28eeee31-0796-4f50-a8ff-aed089fd9efd tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:40.320718 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-28eeee31-0796-4f50-a8ff-aed089fd9efd tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:40.321545 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-28eeee31-0796-4f50-a8ff-aed089fd9efd tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:40.321954 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-28eeee31-0796-4f50-a8ff-aed089fd9efd tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:40.356048 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-28eeee31-0796-4f50-a8ff-aed089fd9efd tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:40.356552 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-28eeee31-0796-4f50-a8ff-aed089fd9efd tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:40.357106 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.objects.instance [None req-28eeee31-0796-4f50-a8ff-aed089fd9efd tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lazy-loading 'fault' on Instance uuid 231ce093-ad72-4ed1-b3aa-f4f87da18ed8 {{(pid=118410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 23:08:40.418406 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-28eeee31-0796-4f50-a8ff-aed089fd9efd tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c4c72b9c83a4967b57b6633f9934dd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0af93f7c6b54114b0e1b5c32e3bf623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:40.422874 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-28eeee31-0796-4f50-a8ff-aed089fd9efd tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 200 len: 1347 microversion: 2.1 time: 0.114647 Jul 25 23:08:40.433149 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 301/600] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:40 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 1347 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:41.244914 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-ff4fdcc1-1674-4e64-b211-5bf1c45fb89a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1118659167", "imageRef": "8e9f3265-0fdf-483a-8e2e-41d408f5f0e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f0e09cb6-a848-408f-8402-d9909d56acd7"}], "security_groups": [{"name": "tempest-securitygroup--155503071"}], "key_name": "tempest-keypair-1693911719", "user_data": "}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:08:41.351804 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.network.neutron [None req-ff4fdcc1-1674-4e64-b211-5bf1c45fb89a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] validate_networks() for [('f0e09cb6-a848-408f-8402-d9909d56acd7', None, None, None, None, None)] {{(pid=118409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 23:08:41.447724 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6fb478bc-5d39-4992-a996-10fd591a9bc5 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:41.449552 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6fb478bc-5d39-4992-a996-10fd591a9bc5 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] [instance: 231ce093-ad72-4ed1-b3aa-f4f87da18ed8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:41.455052 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6fb478bc-5d39-4992-a996-10fd591a9bc5 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:41.455529 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6fb478bc-5d39-4992-a996-10fd591a9bc5 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:41.456772 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6fb478bc-5d39-4992-a996-10fd591a9bc5 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:41.457368 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6fb478bc-5d39-4992-a996-10fd591a9bc5 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:41.474363 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-6fb478bc-5d39-4992-a996-10fd591a9bc5 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] HTTP exception thrown: Instance 231ce093-ad72-4ed1-b3aa-f4f87da18ed8 could not be found. Jul 25 23:08:41.476940 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6fb478bc-5d39-4992-a996-10fd591a9bc5 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Request method failure captured: Jul 25 23:08:41.476940 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 HTTP/1.1 Jul 25 23:08:41.476940 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 25 23:08:41.476940 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 25 23:08:41.476940 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Connection: close Jul 25 23:08:41.476940 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 25 23:08:41.476940 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 25 23:08:41.476940 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Host: 10.222.0.55 Jul 25 23:08:41.476940 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 25 23:08:41.476940 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.10 Jul 25 23:08:41.476940 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABi3yGqIpRWxER2bF6DqyOaDJCU6ErpH_ER5XUsWjaypUT_--wBM62D4pDgq2scFVN_627F6ufkr_EM5MPcSJTNU0K7oQxDxSfoYt2udKdfgXvhmcJZVdPdtgO32uIj03pTZKW3UdCcHmg1c5yeRm6XwQiQjJXU73MzQH8mY5xhx7dS2wU Jul 25 23:08:41.476940 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 25 23:08:41.476940 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 25 23:08:41.476940 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 25 23:08:41.476940 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 25 23:08:41.476940 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 25 23:08:41.476940 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 25 23:08:41.476940 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Id: d0af93f7c6b54114b0e1b5c32e3bf623 Jul 25 23:08:41.476940 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-TestMinimumBasicScenario-174985237 Jul 25 23:08:41.476940 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Role: reader,member Jul 25 23:08:41.476940 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Roles: reader,member Jul 25 23:08:41.478421 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d0af93f7c6b54114b0e1b5c32e3bf623"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d0af93f7c6b54114b0e1b5c32e3bf623"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d0af93f7c6b54114b0e1b5c32e3bf623", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d0af93f7c6b54114b0e1b5c32e3bf623"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:08:41.478421 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-TestMinimumBasicScenario-174985237 Jul 25 23:08:41.478421 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Id: d0af93f7c6b54114b0e1b5c32e3bf623 Jul 25 23:08:41.478421 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-TestMinimumBasicScenario-174985237 Jul 25 23:08:41.478421 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User: tempest-TestMinimumBasicScenario-174985237-project Jul 25 23:08:41.478421 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 25 23:08:41.478421 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 25 23:08:41.478421 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Id: 2c4c72b9c83a4967b57b6633f9934dd4 Jul 25 23:08:41.478421 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-TestMinimumBasicScenario-174985237-project Jul 25 23:08:41.478421 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: method: > Jul 25 23:08:41.478421 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: exception: Instance 231ce093-ad72-4ed1-b3aa-f4f87da18ed8 could not be found. Jul 25 23:08:41.478421 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: action_args: {'id': '231ce093-ad72-4ed1-b3aa-f4f87da18ed8'} Jul 25 23:08:41.479502 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:08:41.479502 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:08:41.479502 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:08:41.479502 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:08:41.479502 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:08:41.479502 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:08:41.479502 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:08:41.479502 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:08:41.479502 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:08:41.479502 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:08:41.479502 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 231ce093-ad72-4ed1-b3aa-f4f87da18ed8 could not be found. Jul 25 23:08:41.479502 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:08:41.479502 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:08:41.479502 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:08:41.479502 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:08:41.479502 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:08:41.479502 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:08:41.479502 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:08:41.479502 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:08:41.479502 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:08:41.480855 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:08:41.480855 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 23:08:41.480855 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 23:08:41.480855 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:08:41.480855 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:08:41.480855 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:08:41.480855 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:08:41.480855 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 231ce093-ad72-4ed1-b3aa-f4f87da18ed8 could not be found. Jul 25 23:08:41.480855 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:08:41.480855 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:08:41.480855 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:08:41.480855 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:08:41.480855 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:08:41.480855 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:08:41.480855 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:08:41.480855 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:08:41.480855 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 231ce093-ad72-4ed1-b3aa-f4f87da18ed8 could not be found. Jul 25 23:08:41.480855 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:08:41.483478 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6fb478bc-5d39-4992-a996-10fd591a9bc5 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Returning 404 to user: Instance 231ce093-ad72-4ed1-b3aa-f4f87da18ed8 could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:08:41.484333 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6fb478bc-5d39-4992-a996-10fd591a9bc5 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8" status: 404 len: 111 microversion: 2.1 time: 0.042213 Jul 25 23:08:41.485231 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 302/601] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:41 2022] GET /compute/v2.1/servers/231ce093-ad72-4ed1-b3aa-f4f87da18ed8 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:08:41.493959 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f5a29928-4477-4148-9510-bd40a0542329 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] Calling method '.version_select at 0x7f622c07c8b0>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:41.573395 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f5a29928-4477-4148-9510-bd40a0542329 tempest-TestMinimumBasicScenario-174985237 tempest-TestMinimumBasicScenario-174985237-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-84918714" status: 202 len: 0 microversion: 2.1 time: 0.083287 Jul 25 23:08:41.573973 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 303/602] 10.222.0.55 () {58 vars in 1266 bytes} [Mon Jul 25 23:08:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-84918714 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 23:08:41.760332 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-ff4fdcc1-1674-4e64-b211-5bf1c45fb89a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Flavor limits 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 23:08:41.760759 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-ff4fdcc1-1674-4e64-b211-5bf1c45fb89a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Image limits 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 23:08:41.761254 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-ff4fdcc1-1674-4e64-b211-5bf1c45fb89a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Flavor pref 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 23:08:41.761927 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-ff4fdcc1-1674-4e64-b211-5bf1c45fb89a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Image pref 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 23:08:41.762107 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-ff4fdcc1-1674-4e64-b211-5bf1c45fb89a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 23:08:41.771808 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ff4fdcc1-1674-4e64-b211-5bf1c45fb89a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:41.772248 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ff4fdcc1-1674-4e64-b211-5bf1c45fb89a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:41.773378 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ff4fdcc1-1674-4e64-b211-5bf1c45fb89a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:41.773818 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ff4fdcc1-1674-4e64-b211-5bf1c45fb89a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:41.792278 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-ff4fdcc1-1674-4e64-b211-5bf1c45fb89a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Getting quotas for project 16a417bb74d445f7b2240ccb27061f05. Resources: {'instances', 'cores', 'ram'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 23:08:41.796171 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-ff4fdcc1-1674-4e64-b211-5bf1c45fb89a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Getting quotas for user fbc4fc1f207c4726b9c05b6b338f0e9c and project 16a417bb74d445f7b2240ccb27061f05. Resources: {'instances', 'cores', 'ram'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 23:08:41.807295 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-ff4fdcc1-1674-4e64-b211-5bf1c45fb89a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Going to run 1 instances... {{(pid=118409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 23:08:41.809659 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-ff4fdcc1-1674-4e64-b211-5bf1c45fb89a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e9f3265-0fdf-483a-8e2e-41d408f5f0e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 23:08:41.957481 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-ff4fdcc1-1674-4e64-b211-5bf1c45fb89a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.716645 Jul 25 23:08:41.958430 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 300/603] 10.222.0.55 () {62 vars in 1188 bytes} [Mon Jul 25 23:08:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 25 23:08:41.969496 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e111928f-585f-4377-aa28-5472f175a45d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:41.970580 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e111928f-585f-4377-aa28-5472f175a45d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:42.031756 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e111928f-585f-4377-aa28-5472f175a45d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:42.048976 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e111928f-585f-4377-aa28-5472f175a45d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:42.050874 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e111928f-585f-4377-aa28-5472f175a45d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:42.051986 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e111928f-585f-4377-aa28-5472f175a45d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1282 microversion: 2.20 time: 0.086427 Jul 25 23:08:42.052533 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 304/604] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:08:41 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1282 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:08:43.075554 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-61166398-a545-47e5-9b55-465ffec9c2e1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:43.076223 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-61166398-a545-47e5-9b55-465ffec9c2e1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:43.084972 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-61166398-a545-47e5-9b55-465ffec9c2e1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:43.085690 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-61166398-a545-47e5-9b55-465ffec9c2e1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:43.086655 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-61166398-a545-47e5-9b55-465ffec9c2e1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:43.087088 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-61166398-a545-47e5-9b55-465ffec9c2e1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:43.178673 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-61166398-a545-47e5-9b55-465ffec9c2e1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:43.187071 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-61166398-a545-47e5-9b55-465ffec9c2e1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:43.188727 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-61166398-a545-47e5-9b55-465ffec9c2e1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:43.189729 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-61166398-a545-47e5-9b55-465ffec9c2e1 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1286 microversion: 2.20 time: 0.119161 Jul 25 23:08:43.190278 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 301/605] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:08:43 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1286 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:08:44.215954 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-90a0d077-af24-4fc6-bb99-b382ec320b1a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:44.217204 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-90a0d077-af24-4fc6-bb99-b382ec320b1a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:44.234647 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-90a0d077-af24-4fc6-bb99-b382ec320b1a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:44.235106 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-90a0d077-af24-4fc6-bb99-b382ec320b1a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:44.235906 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-90a0d077-af24-4fc6-bb99-b382ec320b1a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:44.236874 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-90a0d077-af24-4fc6-bb99-b382ec320b1a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:44.335065 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-90a0d077-af24-4fc6-bb99-b382ec320b1a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:44.343347 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-90a0d077-af24-4fc6-bb99-b382ec320b1a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:44.344833 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-90a0d077-af24-4fc6-bb99-b382ec320b1a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:44.346035 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-90a0d077-af24-4fc6-bb99-b382ec320b1a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1334 microversion: 2.20 time: 0.137882 Jul 25 23:08:44.346657 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 305/606] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:08:44 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1334 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:08:45.369944 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-f006e482-63c3-4446-8e93-bfff7feb7f7a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:45.370780 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-f006e482-63c3-4446-8e93-bfff7feb7f7a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:45.377524 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f006e482-63c3-4446-8e93-bfff7feb7f7a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:45.378459 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f006e482-63c3-4446-8e93-bfff7feb7f7a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:45.379266 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f006e482-63c3-4446-8e93-bfff7feb7f7a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:45.379694 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f006e482-63c3-4446-8e93-bfff7feb7f7a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:45.449463 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-f006e482-63c3-4446-8e93-bfff7feb7f7a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:45.459892 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-f006e482-63c3-4446-8e93-bfff7feb7f7a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:45.461831 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-f006e482-63c3-4446-8e93-bfff7feb7f7a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:45.463388 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-f006e482-63c3-4446-8e93-bfff7feb7f7a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1334 microversion: 2.20 time: 0.097440 Jul 25 23:08:45.464411 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 302/607] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:08:45 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1334 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:08:46.487965 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-8d1474a2-e75a-451c-9815-5bfec6888543 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:46.488585 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-8d1474a2-e75a-451c-9815-5bfec6888543 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:46.496280 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8d1474a2-e75a-451c-9815-5bfec6888543 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:46.496816 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8d1474a2-e75a-451c-9815-5bfec6888543 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:46.506788 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8d1474a2-e75a-451c-9815-5bfec6888543 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:46.506788 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8d1474a2-e75a-451c-9815-5bfec6888543 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:46.567684 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-8d1474a2-e75a-451c-9815-5bfec6888543 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:46.578253 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-8d1474a2-e75a-451c-9815-5bfec6888543 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:46.579828 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-8d1474a2-e75a-451c-9815-5bfec6888543 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:46.581297 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-8d1474a2-e75a-451c-9815-5bfec6888543 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1334 microversion: 2.20 time: 0.097984 Jul 25 23:08:46.582254 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 306/608] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:08:46 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1334 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:08:47.604533 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-721ca86e-ff90-435f-8312-10e238166ca6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:47.605152 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-721ca86e-ff90-435f-8312-10e238166ca6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:47.611527 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-721ca86e-ff90-435f-8312-10e238166ca6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:47.611984 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-721ca86e-ff90-435f-8312-10e238166ca6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:47.612838 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-721ca86e-ff90-435f-8312-10e238166ca6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:47.613337 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-721ca86e-ff90-435f-8312-10e238166ca6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:47.632335 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:08:47.678547 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-721ca86e-ff90-435f-8312-10e238166ca6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:47.687557 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-721ca86e-ff90-435f-8312-10e238166ca6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:47.689068 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-721ca86e-ff90-435f-8312-10e238166ca6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:47.690718 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-721ca86e-ff90-435f-8312-10e238166ca6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1340 microversion: 2.20 time: 0.089903 Jul 25 23:08:47.691530 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 303/609] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:08:47 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1340 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:08:48.715149 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-90369863-98ac-4f89-8f0f-3c4a1d95f78a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:48.716515 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-90369863-98ac-4f89-8f0f-3c4a1d95f78a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:48.728186 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-90369863-98ac-4f89-8f0f-3c4a1d95f78a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:48.728186 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-90369863-98ac-4f89-8f0f-3c4a1d95f78a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:48.728186 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-90369863-98ac-4f89-8f0f-3c4a1d95f78a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:48.728186 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-90369863-98ac-4f89-8f0f-3c4a1d95f78a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:48.882521 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-90369863-98ac-4f89-8f0f-3c4a1d95f78a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:48.891077 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-90369863-98ac-4f89-8f0f-3c4a1d95f78a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:48.893027 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-90369863-98ac-4f89-8f0f-3c4a1d95f78a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:48.894840 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-90369863-98ac-4f89-8f0f-3c4a1d95f78a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1407 microversion: 2.20 time: 0.183723 Jul 25 23:08:48.909802 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 307/610] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:08:48 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:08:49.919970 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-aa708c49-f4df-493e-ae88-ae0fd491ba33 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:49.928087 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-aa708c49-f4df-493e-ae88-ae0fd491ba33 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:49.933774 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-aa708c49-f4df-493e-ae88-ae0fd491ba33 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:49.934234 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-aa708c49-f4df-493e-ae88-ae0fd491ba33 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:49.935012 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-aa708c49-f4df-493e-ae88-ae0fd491ba33 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:49.935482 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-aa708c49-f4df-493e-ae88-ae0fd491ba33 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:50.069236 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-aa708c49-f4df-493e-ae88-ae0fd491ba33 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:50.077508 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-aa708c49-f4df-493e-ae88-ae0fd491ba33 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:50.079006 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-aa708c49-f4df-493e-ae88-ae0fd491ba33 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:50.080120 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-aa708c49-f4df-493e-ae88-ae0fd491ba33 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1407 microversion: 2.20 time: 0.165202 Jul 25 23:08:50.081239 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 304/611] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:08:49 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:08:50.884846 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e250faa5-6e57-4694-8db9-98254e22332c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:50.887175 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e250faa5-6e57-4694-8db9-98254e22332c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:50.894812 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e250faa5-6e57-4694-8db9-98254e22332c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:50.895331 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e250faa5-6e57-4694-8db9-98254e22332c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:50.896105 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e250faa5-6e57-4694-8db9-98254e22332c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:50.896548 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e250faa5-6e57-4694-8db9-98254e22332c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:50.932824 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e250faa5-6e57-4694-8db9-98254e22332c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051832 Jul 25 23:08:50.934280 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 308/612] 10.222.0.55 () {58 vars in 1302 bytes} [Mon Jul 25 23:08:50 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 23:08:51.002606 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-4906065f-a9a6-4706-8263-bebdcc2c6601 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:51.003114 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-4906065f-a9a6-4706-8263-bebdcc2c6601 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:51.010314 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4906065f-a9a6-4706-8263-bebdcc2c6601 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:51.010627 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4906065f-a9a6-4706-8263-bebdcc2c6601 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:51.011403 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4906065f-a9a6-4706-8263-bebdcc2c6601 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:51.011836 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4906065f-a9a6-4706-8263-bebdcc2c6601 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:51.039248 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-4906065f-a9a6-4706-8263-bebdcc2c6601 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Going to try to terminate instance {{(pid=118409) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 23:08:51.104104 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-9585c336-bdfb-4586-b3c7-932d154bb66a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:51.104856 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-9585c336-bdfb-4586-b3c7-932d154bb66a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:51.112463 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9585c336-bdfb-4586-b3c7-932d154bb66a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:51.113410 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9585c336-bdfb-4586-b3c7-932d154bb66a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:51.114434 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9585c336-bdfb-4586-b3c7-932d154bb66a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:51.114867 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9585c336-bdfb-4586-b3c7-932d154bb66a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:51.362812 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-4906065f-a9a6-4706-8263-bebdcc2c6601 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 204 len: 0 microversion: 2.1 time: 0.363175 Jul 25 23:08:51.364019 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 305/613] 10.222.0.55 () {58 vars in 1239 bytes} [Mon Jul 25 23:08:50 2022] DELETE /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 23:08:51.373085 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-f1d5a73c-6bd3-44fb-bb3c-ddd04e604124 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:51.373820 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-f1d5a73c-6bd3-44fb-bb3c-ddd04e604124 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:51.388324 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f1d5a73c-6bd3-44fb-bb3c-ddd04e604124 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:51.388790 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f1d5a73c-6bd3-44fb-bb3c-ddd04e604124 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:51.389660 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f1d5a73c-6bd3-44fb-bb3c-ddd04e604124 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:51.394591 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f1d5a73c-6bd3-44fb-bb3c-ddd04e604124 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:51.637920 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9585c336-bdfb-4586-b3c7-932d154bb66a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:51.668675 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9585c336-bdfb-4586-b3c7-932d154bb66a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:51.676362 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9585c336-bdfb-4586-b3c7-932d154bb66a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:51.677709 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-9585c336-bdfb-4586-b3c7-932d154bb66a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1407 microversion: 2.20 time: 0.577719 Jul 25 23:08:51.682599 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 309/614] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:08:51 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1407 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:08:51.722992 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-386dc668-7097-456e-86ce-9404437d2b58 req-988f7735-5b10-4d98-92e9-65c96e414d3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5f69472-1864-4211-b288-44e579367954", "tag": "c6685a7a-bff1-4d27-8daf-0e1614096b58"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:08:51.739661 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-386dc668-7097-456e-86ce-9404437d2b58 req-988f7735-5b10-4d98-92e9-65c96e414d3c service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:51.741174 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-386dc668-7097-456e-86ce-9404437d2b58 req-988f7735-5b10-4d98-92e9-65c96e414d3c service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:51.754356 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-386dc668-7097-456e-86ce-9404437d2b58 req-988f7735-5b10-4d98-92e9-65c96e414d3c service nova] Creating event network-changed:c6685a7a-bff1-4d27-8daf-0e1614096b58 for instance c5f69472-1864-4211-b288-44e579367954 on hv-cinder-79760 Jul 25 23:08:51.762229 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-386dc668-7097-456e-86ce-9404437d2b58 req-988f7735-5b10-4d98-92e9-65c96e414d3c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062979 Jul 25 23:08:51.763109 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 310/615] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:08:51.785440 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell0:SELECT=2 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:08:51.802616 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell0:SELECT=6 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:08:51.831957 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-f1d5a73c-6bd3-44fb-bb3c-ddd04e604124 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:51.840651 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-f1d5a73c-6bd3-44fb-bb3c-ddd04e604124 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1674 microversion: 2.1 time: 0.472104 Jul 25 23:08:51.842683 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 306/616] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:51 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1674 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:08:52.697590 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=6 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:08:52.701904 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-8c91f110-1188-4735-996b-ddd30eaf6362 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:52.702618 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-8c91f110-1188-4735-996b-ddd30eaf6362 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:52.709388 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8c91f110-1188-4735-996b-ddd30eaf6362 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:52.709832 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8c91f110-1188-4735-996b-ddd30eaf6362 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:52.710593 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8c91f110-1188-4735-996b-ddd30eaf6362 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:52.711024 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8c91f110-1188-4735-996b-ddd30eaf6362 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:52.860784 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-8c91f110-1188-4735-996b-ddd30eaf6362 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:52.866690 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-ab688a8e-26c9-410d-8022-2ec702f118a2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:52.867555 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-ab688a8e-26c9-410d-8022-2ec702f118a2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:52.875225 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ab688a8e-26c9-410d-8022-2ec702f118a2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:52.875680 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ab688a8e-26c9-410d-8022-2ec702f118a2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:52.876498 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ab688a8e-26c9-410d-8022-2ec702f118a2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:52.880425 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:08:52.885606 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-8c91f110-1188-4735-996b-ddd30eaf6362 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:52.887130 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-8c91f110-1188-4735-996b-ddd30eaf6362 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:52.888254 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-8c91f110-1188-4735-996b-ddd30eaf6362 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1407 microversion: 2.20 time: 0.192129 Jul 25 23:08:52.888833 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 311/617] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:08:52 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:08:52.889515 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ab688a8e-26c9-410d-8022-2ec702f118a2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:53.032176 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-ab688a8e-26c9-410d-8022-2ec702f118a2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:53.040447 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-ab688a8e-26c9-410d-8022-2ec702f118a2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1674 microversion: 2.1 time: 0.178244 Jul 25 23:08:53.041030 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 307/618] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:52 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1674 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:53.912953 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4eb72b03-aac1-4eb6-bd8f-3898620791d5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:53.913737 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4eb72b03-aac1-4eb6-bd8f-3898620791d5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:53.925939 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4eb72b03-aac1-4eb6-bd8f-3898620791d5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:53.927473 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4eb72b03-aac1-4eb6-bd8f-3898620791d5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:53.928497 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4eb72b03-aac1-4eb6-bd8f-3898620791d5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:53.929167 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4eb72b03-aac1-4eb6-bd8f-3898620791d5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:54.064438 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-c362ef6a-d4c9-43d1-b47b-91be882ed6df tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:54.065748 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-c362ef6a-d4c9-43d1-b47b-91be882ed6df tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:54.072548 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c362ef6a-d4c9-43d1-b47b-91be882ed6df tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:54.073223 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c362ef6a-d4c9-43d1-b47b-91be882ed6df tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:54.074160 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c362ef6a-d4c9-43d1-b47b-91be882ed6df tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:54.074749 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c362ef6a-d4c9-43d1-b47b-91be882ed6df tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:54.296353 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4eb72b03-aac1-4eb6-bd8f-3898620791d5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:54.312142 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4eb72b03-aac1-4eb6-bd8f-3898620791d5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:54.313846 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4eb72b03-aac1-4eb6-bd8f-3898620791d5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:54.315173 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4eb72b03-aac1-4eb6-bd8f-3898620791d5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1407 microversion: 2.20 time: 0.407032 Jul 25 23:08:54.322124 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 312/619] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:08:53 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1407 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:08:54.436676 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-c362ef6a-d4c9-43d1-b47b-91be882ed6df tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:54.446162 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-c362ef6a-d4c9-43d1-b47b-91be882ed6df tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1674 microversion: 2.1 time: 0.386806 Jul 25 23:08:54.457916 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 308/620] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:54 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1674 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:54.904749 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-7f091c2f-82b1-45d0-9627-8486dffcfdff req-6e014730-098c-4929-bb18-164352513198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6efbf144-c03b-44d4-ad8f-0382560ed59d", "name": "network-vif-deleted", "tag": "0d5cf52c-9ff5-4944-b3a7-c07d730ee932"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:08:54.914789 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-7f091c2f-82b1-45d0-9627-8486dffcfdff req-6e014730-098c-4929-bb18-164352513198 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:54.915381 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-7f091c2f-82b1-45d0-9627-8486dffcfdff req-6e014730-098c-4929-bb18-164352513198 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:54.927074 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-7f091c2f-82b1-45d0-9627-8486dffcfdff req-6e014730-098c-4929-bb18-164352513198 service nova] Creating event network-vif-deleted:0d5cf52c-9ff5-4944-b3a7-c07d730ee932 for instance 6efbf144-c03b-44d4-ad8f-0382560ed59d on hv-cinder-79760 Jul 25 23:08:54.931802 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-7f091c2f-82b1-45d0-9627-8486dffcfdff req-6e014730-098c-4929-bb18-164352513198 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030982 Jul 25 23:08:54.932587 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 313/621] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:08:55.347486 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-a4290454-5992-4f85-a67a-03bd6f741c7d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:55.348194 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-a4290454-5992-4f85-a67a-03bd6f741c7d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:55.354781 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a4290454-5992-4f85-a67a-03bd6f741c7d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:55.355223 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a4290454-5992-4f85-a67a-03bd6f741c7d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:55.356079 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a4290454-5992-4f85-a67a-03bd6f741c7d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:55.356405 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a4290454-5992-4f85-a67a-03bd6f741c7d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:55.363759 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d8150594-f345-4ab7-a645-292f7394cce8 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:55.368437 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-d8150594-f345-4ab7-a645-292f7394cce8 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fd5cd68d-b7c2-48c3-813a-337a6ba8472f] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:55.372735 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d8150594-f345-4ab7-a645-292f7394cce8 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:55.373220 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d8150594-f345-4ab7-a645-292f7394cce8 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:55.373981 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d8150594-f345-4ab7-a645-292f7394cce8 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:55.374436 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d8150594-f345-4ab7-a645-292f7394cce8 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:55.467280 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.objects.instance [None req-d8150594-f345-4ab7-a645-292f7394cce8 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lazy-loading 'services' on Instance uuid fd5cd68d-b7c2-48c3-813a-337a6ba8472f {{(pid=118410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 23:08:55.522777 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-a4290454-5992-4f85-a67a-03bd6f741c7d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:55.531697 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-a4290454-5992-4f85-a67a-03bd6f741c7d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:55.538759 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-a4290454-5992-4f85-a67a-03bd6f741c7d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:55.539944 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-a4290454-5992-4f85-a67a-03bd6f741c7d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1407 microversion: 2.20 time: 0.197331 Jul 25 23:08:55.540846 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 309/622] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:08:55 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:08:55.545869 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-06d59d53-876f-4f71-991e-13af8fda4ab4 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:55.546468 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-06d59d53-876f-4f71-991e-13af8fda4ab4 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:55.553238 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-06d59d53-876f-4f71-991e-13af8fda4ab4 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:55.554301 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-06d59d53-876f-4f71-991e-13af8fda4ab4 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:55.555365 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-06d59d53-876f-4f71-991e-13af8fda4ab4 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:55.555819 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-06d59d53-876f-4f71-991e-13af8fda4ab4 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:55.623161 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-06d59d53-876f-4f71-991e-13af8fda4ab4 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:55.632275 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-06d59d53-876f-4f71-991e-13af8fda4ab4 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 200 len: 1323 microversion: 2.1 time: 0.090188 Jul 25 23:08:55.632837 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 310/623] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:55 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 1323 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:55.726751 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-d8150594-f345-4ab7-a645-292f7394cce8 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "DELETE /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f/os-volume_attachments/dd5fa439-64d0-4d72-9841-be0ce18001ab" status: 202 len: 0 microversion: 2.1 time: 0.367847 Jul 25 23:08:55.727951 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 314/624] 10.222.0.55 () {58 vars in 1416 bytes} [Mon Jul 25 23:08:55 2022] DELETE /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f/os-volume_attachments/dd5fa439-64d0-4d72-9841-be0ce18001ab => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 23:08:56.564686 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-d480537f-92e5-48d5-936c-de7170793b06 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:56.566683 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-d480537f-92e5-48d5-936c-de7170793b06 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:56.574413 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d480537f-92e5-48d5-936c-de7170793b06 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:56.575208 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d480537f-92e5-48d5-936c-de7170793b06 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:56.576157 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d480537f-92e5-48d5-936c-de7170793b06 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:56.576734 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d480537f-92e5-48d5-936c-de7170793b06 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:56.655110 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-adebb03d-ef2b-4167-9e1d-8862d2ce6851 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:56.655794 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-adebb03d-ef2b-4167-9e1d-8862d2ce6851 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:56.662976 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-adebb03d-ef2b-4167-9e1d-8862d2ce6851 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:56.663410 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-adebb03d-ef2b-4167-9e1d-8862d2ce6851 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:56.664178 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-adebb03d-ef2b-4167-9e1d-8862d2ce6851 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:56.664609 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-adebb03d-ef2b-4167-9e1d-8862d2ce6851 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:56.679087 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-adebb03d-ef2b-4167-9e1d-8862d2ce6851 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] HTTP exception thrown: Instance 6efbf144-c03b-44d4-ad8f-0382560ed59d could not be found. Jul 25 23:08:56.680756 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-adebb03d-ef2b-4167-9e1d-8862d2ce6851 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Request method failure captured: Jul 25 23:08:56.680756 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d HTTP/1.1 Jul 25 23:08:56.680756 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 25 23:08:56.680756 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 25 23:08:56.680756 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Connection: close Jul 25 23:08:56.680756 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 25 23:08:56.680756 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 25 23:08:56.680756 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Host: 10.222.0.55 Jul 25 23:08:56.680756 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 25 23:08:56.680756 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.10 Jul 25 23:08:56.680756 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABi3yFo_tIojYVjGSyPNnsCOmVzSmhsMzU-aCps7S4Bg5YP14BzxTujy_Jw32T068wClp37u14xG0eRRAX-sOTSEox01hQPRKMnkl3sGuiXygMuZk_hwxD2nQAIdMbgyaG15J7NMphgvWwnthNIMAa88y8cvgOT1LG8zlva6Nrg9296ZxM Jul 25 23:08:56.680756 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 25 23:08:56.680756 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 25 23:08:56.680756 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 25 23:08:56.680756 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 25 23:08:56.680756 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 25 23:08:56.680756 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 25 23:08:56.680756 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Id: f0c3fc0630dd4083bcc8a9f70af99463 Jul 25 23:08:56.680756 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-AttachVolumeTestJSON-677038220 Jul 25 23:08:56.680756 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Role: reader,member Jul 25 23:08:56.680756 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Roles: reader,member Jul 25 23:08:56.682505 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f0c3fc0630dd4083bcc8a9f70af99463"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f0c3fc0630dd4083bcc8a9f70af99463"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f0c3fc0630dd4083bcc8a9f70af99463", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f0c3fc0630dd4083bcc8a9f70af99463"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:08:56.682505 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-AttachVolumeTestJSON-677038220 Jul 25 23:08:56.682505 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Id: f0c3fc0630dd4083bcc8a9f70af99463 Jul 25 23:08:56.682505 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-AttachVolumeTestJSON-677038220 Jul 25 23:08:56.682505 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User: tempest-AttachVolumeTestJSON-677038220-project Jul 25 23:08:56.682505 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 25 23:08:56.682505 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 25 23:08:56.682505 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Id: 4eea5a29c87d431299b220e404fd5732 Jul 25 23:08:56.682505 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-AttachVolumeTestJSON-677038220-project Jul 25 23:08:56.682505 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: method: > Jul 25 23:08:56.682505 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: exception: Instance 6efbf144-c03b-44d4-ad8f-0382560ed59d could not be found. Jul 25 23:08:56.682505 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: action_args: {'id': '6efbf144-c03b-44d4-ad8f-0382560ed59d'} Jul 25 23:08:56.684344 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:08:56.684344 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:08:56.684344 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:08:56.684344 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:08:56.684344 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:08:56.684344 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:08:56.684344 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:08:56.684344 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:08:56.684344 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:08:56.684344 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:08:56.684344 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6efbf144-c03b-44d4-ad8f-0382560ed59d could not be found. Jul 25 23:08:56.684344 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:08:56.684344 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:08:56.684344 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:08:56.684344 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:08:56.684344 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:08:56.684344 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:08:56.684344 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:08:56.684344 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:08:56.684344 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:08:56.686419 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:08:56.686419 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 23:08:56.686419 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 23:08:56.686419 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:08:56.686419 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:08:56.686419 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:08:56.686419 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:08:56.686419 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6efbf144-c03b-44d4-ad8f-0382560ed59d could not be found. Jul 25 23:08:56.686419 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:08:56.686419 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:08:56.686419 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:08:56.686419 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:08:56.686419 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:08:56.686419 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:08:56.686419 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:08:56.686419 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:08:56.686419 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6efbf144-c03b-44d4-ad8f-0382560ed59d could not be found. Jul 25 23:08:56.686419 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:08:56.688012 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-adebb03d-ef2b-4167-9e1d-8862d2ce6851 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Returning 404 to user: Instance 6efbf144-c03b-44d4-ad8f-0382560ed59d could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:08:56.688012 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-adebb03d-ef2b-4167-9e1d-8862d2ce6851 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 404 len: 111 microversion: 2.1 time: 0.031923 Jul 25 23:08:56.688012 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 315/625] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:56 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 23:08:56.691621 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-2a11e7fd-1001-49a3-beb9-07dd394a3cfc tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '.version_select at 0x7f6226d22ee0>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:56.726641 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-d480537f-92e5-48d5-936c-de7170793b06 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:56.734859 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-d480537f-92e5-48d5-936c-de7170793b06 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:56.736346 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-d480537f-92e5-48d5-936c-de7170793b06 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:56.738224 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-d480537f-92e5-48d5-936c-de7170793b06 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1407 microversion: 2.20 time: 0.177661 Jul 25 23:08:56.738785 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 311/626] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:08:56 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:08:56.777324 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-2a11e7fd-1001-49a3-beb9-07dd394a3cfc tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1999345081" status: 202 len: 0 microversion: 2.1 time: 0.090032 Jul 25 23:08:56.778129 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 316/627] 10.222.0.55 () {58 vars in 1221 bytes} [Mon Jul 25 23:08:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1999345081 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 23:08:57.582883 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-7593d5a4-c4d5-44da-b143-c92f6fde3066 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Action: 'create', calling method: .version_select at 0x7f6226e4d670>, body: {"keypair": {"name": "tempest-keypair-1690200607", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ4vNRjMRwFw2QWJA2vbsn9Kq6l9c/c1HCDIFXhP0Wp+c2jTZPGwHY2OkWn5pyUhVfBLI1/wEaowAi5s6TZpxaCdJoJ+da0hwb/D34G3wLW4waNba8pawB98EXg/o+LUlg=="}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:08:57.599283 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-7593d5a4-c4d5-44da-b143-c92f6fde3066 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Getting quotas for project f0c3fc0630dd4083bcc8a9f70af99463. Resources: {'key_pairs'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 23:08:57.603152 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-7593d5a4-c4d5-44da-b143-c92f6fde3066 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Getting quotas for user 4eea5a29c87d431299b220e404fd5732 and project f0c3fc0630dd4083bcc8a9f70af99463. Resources: {'key_pairs'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 23:08:57.676086 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-7593d5a4-c4d5-44da-b143-c92f6fde3066 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.097519 Jul 25 23:08:57.676685 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 312/628] 10.222.0.55 () {60 vars in 1159 bytes} [Mon Jul 25 23:08:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:08:57.761396 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-67febf03-c57c-4246-8ee8-47cf56c64fb2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:57.762152 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-67febf03-c57c-4246-8ee8-47cf56c64fb2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:57.768936 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-67febf03-c57c-4246-8ee8-47cf56c64fb2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:57.769411 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-67febf03-c57c-4246-8ee8-47cf56c64fb2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:57.770179 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-67febf03-c57c-4246-8ee8-47cf56c64fb2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:57.770610 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-67febf03-c57c-4246-8ee8-47cf56c64fb2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:57.914231 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-7285708c-8544-4fad-b6e8-aae6bf8c98e0 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:57.914811 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-7285708c-8544-4fad-b6e8-aae6bf8c98e0 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fd5cd68d-b7c2-48c3-813a-337a6ba8472f] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:57.921472 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7285708c-8544-4fad-b6e8-aae6bf8c98e0 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:57.921920 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7285708c-8544-4fad-b6e8-aae6bf8c98e0 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:57.922062 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-67febf03-c57c-4246-8ee8-47cf56c64fb2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:57.925260 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7285708c-8544-4fad-b6e8-aae6bf8c98e0 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:57.925260 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7285708c-8544-4fad-b6e8-aae6bf8c98e0 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:57.931067 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-67febf03-c57c-4246-8ee8-47cf56c64fb2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:57.932557 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-67febf03-c57c-4246-8ee8-47cf56c64fb2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:57.933689 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-67febf03-c57c-4246-8ee8-47cf56c64fb2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1407 microversion: 2.20 time: 0.176850 Jul 25 23:08:57.934238 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 317/629] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:08:57 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:08:57.952330 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-7285708c-8544-4fad-b6e8-aae6bf8c98e0 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fd5cd68d-b7c2-48c3-813a-337a6ba8472f] Going to try to terminate instance {{(pid=118409) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 23:08:58.161089 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-7285708c-8544-4fad-b6e8-aae6bf8c98e0 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "DELETE /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f" status: 204 len: 0 microversion: 2.1 time: 0.250786 Jul 25 23:08:58.161813 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 313/630] 10.222.0.55 () {58 vars in 1239 bytes} [Mon Jul 25 23:08:57 2022] DELETE /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 23:08:58.169996 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-55a0d1aa-048d-47ea-a107-8205fd117be5 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:58.170600 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-55a0d1aa-048d-47ea-a107-8205fd117be5 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fd5cd68d-b7c2-48c3-813a-337a6ba8472f] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:58.177901 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-55a0d1aa-048d-47ea-a107-8205fd117be5 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:58.178775 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-55a0d1aa-048d-47ea-a107-8205fd117be5 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:58.179179 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-55a0d1aa-048d-47ea-a107-8205fd117be5 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:58.179611 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-55a0d1aa-048d-47ea-a107-8205fd117be5 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:58.316756 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-55a0d1aa-048d-47ea-a107-8205fd117be5 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:58.324505 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-55a0d1aa-048d-47ea-a107-8205fd117be5 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f" status: 200 len: 1514 microversion: 2.1 time: 0.158366 Jul 25 23:08:58.325079 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 318/631] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:58 2022] GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:58.959433 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-cbba3f85-51cb-4607-9971-53994d302aef tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:58.960366 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-cbba3f85-51cb-4607-9971-53994d302aef tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:58.967003 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cbba3f85-51cb-4607-9971-53994d302aef tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:58.967445 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cbba3f85-51cb-4607-9971-53994d302aef tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:58.968209 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cbba3f85-51cb-4607-9971-53994d302aef tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:58.968637 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cbba3f85-51cb-4607-9971-53994d302aef tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:59.104151 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-cbba3f85-51cb-4607-9971-53994d302aef tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:59.112286 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-cbba3f85-51cb-4607-9971-53994d302aef tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:59.113898 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-cbba3f85-51cb-4607-9971-53994d302aef tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:59.115008 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-cbba3f85-51cb-4607-9971-53994d302aef tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1407 microversion: 2.20 time: 0.162217 Jul 25 23:08:59.115563 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 314/632] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:08:58 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:08:59.347771 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e130f46c-a03c-4282-a9dc-7bd708b6af5f tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:08:59.348648 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e130f46c-a03c-4282-a9dc-7bd708b6af5f tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fd5cd68d-b7c2-48c3-813a-337a6ba8472f] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:08:59.355770 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e130f46c-a03c-4282-a9dc-7bd708b6af5f tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:59.356416 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e130f46c-a03c-4282-a9dc-7bd708b6af5f tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:59.357288 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e130f46c-a03c-4282-a9dc-7bd708b6af5f tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:08:59.357990 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e130f46c-a03c-4282-a9dc-7bd708b6af5f tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:08:59.498807 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e130f46c-a03c-4282-a9dc-7bd708b6af5f tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:08:59.506965 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e130f46c-a03c-4282-a9dc-7bd708b6af5f tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f" status: 200 len: 1514 microversion: 2.1 time: 0.164083 Jul 25 23:08:59.507838 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 319/633] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:08:59 2022] GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:08:59.858013 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-e1e2d7b3-efb0-41ca-bf1c-271ef62e49ba tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-736876983", "imageRef": "8e9f3265-0fdf-483a-8e2e-41d408f5f0e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "09c1c1f4-d415-48ff-a3a2-a8d6dd2d762b"}], "security_groups": [{"name": "tempest-securitygroup--1587804714"}], "key_name": "tempest-keypair-1690200607", "user_data": "}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:08:59.992496 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.network.neutron [None req-e1e2d7b3-efb0-41ca-bf1c-271ef62e49ba tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] validate_networks() for [('09c1c1f4-d415-48ff-a3a2-a8d6dd2d762b', None, None, None, None, None)] {{(pid=118409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 23:09:00.139889 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-286b61eb-b40e-4198-8f85-e4000a128b9e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:00.140388 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-286b61eb-b40e-4198-8f85-e4000a128b9e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:00.146999 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-286b61eb-b40e-4198-8f85-e4000a128b9e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:00.147703 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-286b61eb-b40e-4198-8f85-e4000a128b9e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:00.148475 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-286b61eb-b40e-4198-8f85-e4000a128b9e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:00.148919 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-286b61eb-b40e-4198-8f85-e4000a128b9e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:00.708292 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-286b61eb-b40e-4198-8f85-e4000a128b9e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:00.716991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-286b61eb-b40e-4198-8f85-e4000a128b9e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:00.719031 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-286b61eb-b40e-4198-8f85-e4000a128b9e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:00.724035 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-286b61eb-b40e-4198-8f85-e4000a128b9e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1407 microversion: 2.20 time: 0.584710 Jul 25 23:09:00.724035 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 320/634] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:09:00 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1407 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:09:00.726069 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-45b49e04-f138-43e8-afe0-f4c1b73e44a5 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:00.726668 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-45b49e04-f138-43e8-afe0-f4c1b73e44a5 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fd5cd68d-b7c2-48c3-813a-337a6ba8472f] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:00.743176 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-45b49e04-f138-43e8-afe0-f4c1b73e44a5 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:00.743815 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-45b49e04-f138-43e8-afe0-f4c1b73e44a5 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:00.744767 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-45b49e04-f138-43e8-afe0-f4c1b73e44a5 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:00.745400 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-45b49e04-f138-43e8-afe0-f4c1b73e44a5 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:01.031745 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-45b49e04-f138-43e8-afe0-f4c1b73e44a5 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:01.039547 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-e1e2d7b3-efb0-41ca-bf1c-271ef62e49ba tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Flavor limits 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 23:09:01.040064 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-45b49e04-f138-43e8-afe0-f4c1b73e44a5 tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f" status: 200 len: 1514 microversion: 2.1 time: 0.318107 Jul 25 23:09:01.040166 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-e1e2d7b3-efb0-41ca-bf1c-271ef62e49ba tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Image limits 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 23:09:01.040834 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-e1e2d7b3-efb0-41ca-bf1c-271ef62e49ba tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Flavor pref 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 23:09:01.041368 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 321/635] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:00 2022] GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f => generated 1514 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:09:01.041684 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-e1e2d7b3-efb0-41ca-bf1c-271ef62e49ba tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Image pref 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 23:09:01.042266 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-e1e2d7b3-efb0-41ca-bf1c-271ef62e49ba tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 23:09:01.046969 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-ed7da9bc-4797-41b4-a84e-184eb47f3f54 req-32bf4a72-4b19-4b1b-94a2-163e5f3bc655 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5f69472-1864-4211-b288-44e579367954", "name": "network-vif-plugged", "status": "completed", "tag": "c6685a7a-bff1-4d27-8daf-0e1614096b58"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:09:01.054329 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e1e2d7b3-efb0-41ca-bf1c-271ef62e49ba tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:01.055132 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e1e2d7b3-efb0-41ca-bf1c-271ef62e49ba tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:01.056169 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e1e2d7b3-efb0-41ca-bf1c-271ef62e49ba tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:01.056709 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e1e2d7b3-efb0-41ca-bf1c-271ef62e49ba tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:01.058445 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-ed7da9bc-4797-41b4-a84e-184eb47f3f54 req-32bf4a72-4b19-4b1b-94a2-163e5f3bc655 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:01.058877 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-ed7da9bc-4797-41b4-a84e-184eb47f3f54 req-32bf4a72-4b19-4b1b-94a2-163e5f3bc655 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:01.071939 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-ed7da9bc-4797-41b4-a84e-184eb47f3f54 req-32bf4a72-4b19-4b1b-94a2-163e5f3bc655 service nova] Creating event network-vif-plugged:c6685a7a-bff1-4d27-8daf-0e1614096b58 for instance c5f69472-1864-4211-b288-44e579367954 on hv-cinder-79760 Jul 25 23:09:01.077894 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-ed7da9bc-4797-41b4-a84e-184eb47f3f54 req-32bf4a72-4b19-4b1b-94a2-163e5f3bc655 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034998 Jul 25 23:09:01.078960 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 322/636] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:09:01.083898 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-e1e2d7b3-efb0-41ca-bf1c-271ef62e49ba tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Getting quotas for project f0c3fc0630dd4083bcc8a9f70af99463. Resources: {'instances', 'cores', 'ram'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 23:09:01.088448 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-e1e2d7b3-efb0-41ca-bf1c-271ef62e49ba tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Getting quotas for user 4eea5a29c87d431299b220e404fd5732 and project f0c3fc0630dd4083bcc8a9f70af99463. Resources: {'instances', 'cores', 'ram'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 23:09:01.100280 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-e1e2d7b3-efb0-41ca-bf1c-271ef62e49ba tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Going to run 1 instances... {{(pid=118409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 23:09:01.102648 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-e1e2d7b3-efb0-41ca-bf1c-271ef62e49ba tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e9f3265-0fdf-483a-8e2e-41d408f5f0e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 23:09:01.220574 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-3225f95c-64e5-494f-99d5-ec1effe316f0 req-a86cd8ac-a7a0-40d3-8cfc-c3338ab45750 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd5cd68d-b7c2-48c3-813a-337a6ba8472f", "name": "network-vif-deleted", "tag": "ef2b1954-33ca-4375-97d3-e90ba0e025ed"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:09:01.231094 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-3225f95c-64e5-494f-99d5-ec1effe316f0 req-a86cd8ac-a7a0-40d3-8cfc-c3338ab45750 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:01.231537 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-3225f95c-64e5-494f-99d5-ec1effe316f0 req-a86cd8ac-a7a0-40d3-8cfc-c3338ab45750 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:01.243193 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-3225f95c-64e5-494f-99d5-ec1effe316f0 req-a86cd8ac-a7a0-40d3-8cfc-c3338ab45750 service nova] Creating event network-vif-deleted:ef2b1954-33ca-4375-97d3-e90ba0e025ed for instance fd5cd68d-b7c2-48c3-813a-337a6ba8472f on hv-cinder-79760 Jul 25 23:09:01.248126 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-3225f95c-64e5-494f-99d5-ec1effe316f0 req-a86cd8ac-a7a0-40d3-8cfc-c3338ab45750 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031566 Jul 25 23:09:01.248747 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 323/637] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:09:01.259265 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-e1e2d7b3-efb0-41ca-bf1c-271ef62e49ba tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.405413 Jul 25 23:09:01.259867 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 315/638] 10.222.0.55 () {60 vars in 1147 bytes} [Mon Jul 25 23:08:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 1407 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 23:09:01.271921 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-844cb746-14b2-430d-ba2f-424a7494a703 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:01.272973 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-844cb746-14b2-430d-ba2f-424a7494a703 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:01.332684 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-844cb746-14b2-430d-ba2f-424a7494a703 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:01.340819 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-844cb746-14b2-430d-ba2f-424a7494a703 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9" status: 200 len: 1237 microversion: 2.1 time: 0.073607 Jul 25 23:09:01.341508 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 324/639] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:01 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9 => generated 1237 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:09:01.743709 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-4af3d44c-4337-40c0-b9b4-d44f77cdd48e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:01.744448 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-4af3d44c-4337-40c0-b9b4-d44f77cdd48e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:01.746567 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=3,nova_api:INSERT=7 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:09:01.751618 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4af3d44c-4337-40c0-b9b4-d44f77cdd48e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:01.752096 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4af3d44c-4337-40c0-b9b4-d44f77cdd48e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:01.753973 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4af3d44c-4337-40c0-b9b4-d44f77cdd48e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:01.754664 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4af3d44c-4337-40c0-b9b4-d44f77cdd48e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:01.891203 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-4af3d44c-4337-40c0-b9b4-d44f77cdd48e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:01.899619 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-4af3d44c-4337-40c0-b9b4-d44f77cdd48e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:01.901278 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-4af3d44c-4337-40c0-b9b4-d44f77cdd48e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:01.902383 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-4af3d44c-4337-40c0-b9b4-d44f77cdd48e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1407 microversion: 2.20 time: 0.162783 Jul 25 23:09:01.903052 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 316/640] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:09:01 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:09:02.061939 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-fa8f8fc4-3373-4234-8142-fd72e4ec5aac tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:02.062491 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-fa8f8fc4-3373-4234-8142-fd72e4ec5aac tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fd5cd68d-b7c2-48c3-813a-337a6ba8472f] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:02.070170 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fa8f8fc4-3373-4234-8142-fd72e4ec5aac tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:02.070616 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fa8f8fc4-3373-4234-8142-fd72e4ec5aac tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:02.071410 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fa8f8fc4-3373-4234-8142-fd72e4ec5aac tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:02.072037 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fa8f8fc4-3373-4234-8142-fd72e4ec5aac tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:02.103428 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:09:02.107079 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fa8f8fc4-3373-4234-8142-fd72e4ec5aac tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:02.107518 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fa8f8fc4-3373-4234-8142-fd72e4ec5aac tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:02.108108 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.objects.instance [None req-fa8f8fc4-3373-4234-8142-fd72e4ec5aac tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lazy-loading 'fault' on Instance uuid fd5cd68d-b7c2-48c3-813a-337a6ba8472f {{(pid=118410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 23:09:02.153437 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-fa8f8fc4-3373-4234-8142-fd72e4ec5aac tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:02.162219 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-fa8f8fc4-3373-4234-8142-fd72e4ec5aac tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f" status: 200 len: 1309 microversion: 2.1 time: 0.104295 Jul 25 23:09:02.162761 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 325/641] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:02 2022] GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:09:02.364760 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-5d991bbb-2abb-48b5-9dde-ffeef6a23ae7 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:02.367090 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-5d991bbb-2abb-48b5-9dde-ffeef6a23ae7 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:02.372367 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5d991bbb-2abb-48b5-9dde-ffeef6a23ae7 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:02.372815 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5d991bbb-2abb-48b5-9dde-ffeef6a23ae7 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:02.373707 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5d991bbb-2abb-48b5-9dde-ffeef6a23ae7 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:02.374169 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5d991bbb-2abb-48b5-9dde-ffeef6a23ae7 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:02.438321 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-5d991bbb-2abb-48b5-9dde-ffeef6a23ae7 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:02.446531 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-5d991bbb-2abb-48b5-9dde-ffeef6a23ae7 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9" status: 200 len: 1241 microversion: 2.1 time: 0.086784 Jul 25 23:09:02.447092 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 317/642] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:02 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9 => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:09:02.926758 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-41a30151-bca5-4f46-b22d-2fc9009c4dd9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:02.927351 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-41a30151-bca5-4f46-b22d-2fc9009c4dd9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:02.933676 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-41a30151-bca5-4f46-b22d-2fc9009c4dd9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:02.934128 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-41a30151-bca5-4f46-b22d-2fc9009c4dd9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:02.934948 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-41a30151-bca5-4f46-b22d-2fc9009c4dd9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:02.935379 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-41a30151-bca5-4f46-b22d-2fc9009c4dd9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:03.073896 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-41a30151-bca5-4f46-b22d-2fc9009c4dd9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:03.092278 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-41a30151-bca5-4f46-b22d-2fc9009c4dd9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:03.092278 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-41a30151-bca5-4f46-b22d-2fc9009c4dd9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:03.092278 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-41a30151-bca5-4f46-b22d-2fc9009c4dd9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1407 microversion: 2.20 time: 0.162976 Jul 25 23:09:03.092643 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 326/643] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:09:02 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:09:03.184646 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-a4451d08-b3f6-4163-b4c7-bd6eaec9fdcc tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:03.185304 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-a4451d08-b3f6-4163-b4c7-bd6eaec9fdcc tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fd5cd68d-b7c2-48c3-813a-337a6ba8472f] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:03.191541 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a4451d08-b3f6-4163-b4c7-bd6eaec9fdcc tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:03.191983 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a4451d08-b3f6-4163-b4c7-bd6eaec9fdcc tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:03.192738 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a4451d08-b3f6-4163-b4c7-bd6eaec9fdcc tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:03.193198 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a4451d08-b3f6-4163-b4c7-bd6eaec9fdcc tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:03.210996 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:09:03.224091 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a4451d08-b3f6-4163-b4c7-bd6eaec9fdcc tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:03.224529 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a4451d08-b3f6-4163-b4c7-bd6eaec9fdcc tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:03.224969 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.objects.instance [None req-a4451d08-b3f6-4163-b4c7-bd6eaec9fdcc tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lazy-loading 'fault' on Instance uuid fd5cd68d-b7c2-48c3-813a-337a6ba8472f {{(pid=118409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 23:09:03.271986 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-a4451d08-b3f6-4163-b4c7-bd6eaec9fdcc tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec45d64732fe4aac9fe6b9d6cd04a6f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78f2a5cc4b7d4699ad5b00d3f3a9830e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:03.279781 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-a4451d08-b3f6-4163-b4c7-bd6eaec9fdcc tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f" status: 200 len: 1309 microversion: 2.1 time: 0.099115 Jul 25 23:09:03.280335 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 318/644] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:03 2022] GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f => generated 1309 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:09:03.469346 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f9c30125-e8f9-4c95-a59b-167458f923a0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:03.469937 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f9c30125-e8f9-4c95-a59b-167458f923a0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:03.476171 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f9c30125-e8f9-4c95-a59b-167458f923a0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:03.476612 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f9c30125-e8f9-4c95-a59b-167458f923a0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:03.477405 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f9c30125-e8f9-4c95-a59b-167458f923a0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:03.477924 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f9c30125-e8f9-4c95-a59b-167458f923a0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:03.541447 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f9c30125-e8f9-4c95-a59b-167458f923a0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:03.549268 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f9c30125-e8f9-4c95-a59b-167458f923a0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9" status: 200 len: 1289 microversion: 2.1 time: 0.085111 Jul 25 23:09:03.550691 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 327/645] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:03 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9 => generated 1289 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:09:04.108995 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-fbf65bf4-ec5a-4d29-97ce-a08d695fe7dc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:04.109521 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-fbf65bf4-ec5a-4d29-97ce-a08d695fe7dc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:04.118988 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-fbf65bf4-ec5a-4d29-97ce-a08d695fe7dc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:04.119432 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-fbf65bf4-ec5a-4d29-97ce-a08d695fe7dc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:04.120237 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-fbf65bf4-ec5a-4d29-97ce-a08d695fe7dc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:04.120668 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-fbf65bf4-ec5a-4d29-97ce-a08d695fe7dc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:04.302326 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a43f64e2-1989-4875-b901-85783fa093ea tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:04.302687 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a43f64e2-1989-4875-b901-85783fa093ea tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] [instance: fd5cd68d-b7c2-48c3-813a-337a6ba8472f] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:04.309163 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a43f64e2-1989-4875-b901-85783fa093ea tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:04.309533 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a43f64e2-1989-4875-b901-85783fa093ea tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:04.310292 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a43f64e2-1989-4875-b901-85783fa093ea tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:04.310911 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a43f64e2-1989-4875-b901-85783fa093ea tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:04.325790 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-a43f64e2-1989-4875-b901-85783fa093ea tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] HTTP exception thrown: Instance fd5cd68d-b7c2-48c3-813a-337a6ba8472f could not be found. Jul 25 23:09:04.327856 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a43f64e2-1989-4875-b901-85783fa093ea tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Request method failure captured: Jul 25 23:09:04.327856 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f HTTP/1.1 Jul 25 23:09:04.327856 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 25 23:09:04.327856 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 25 23:09:04.327856 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Connection: close Jul 25 23:09:04.327856 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 25 23:09:04.327856 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 25 23:09:04.327856 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Host: 10.222.0.55 Jul 25 23:09:04.327856 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 25 23:09:04.327856 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.10 Jul 25 23:09:04.327856 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABi3yHtyuJZwLfjpoydB1MfpjCFGlaabIxaQ5JyHTkarO7Nhca2Lvy_3HpY3fGgXsz-_83S1DcuZQQ6FNMQ3ML2Se2ugfAP09Fkz0UTyeruM4jlMx7GE0V66eQNPt7H87dIVOloQfF9ZZEY0_VN0PaEnhVruZjW1R3mjdQeH5cbcC_sXP4 Jul 25 23:09:04.327856 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 25 23:09:04.327856 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 25 23:09:04.327856 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 25 23:09:04.327856 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 25 23:09:04.327856 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 25 23:09:04.327856 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 25 23:09:04.327856 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Id: 78f2a5cc4b7d4699ad5b00d3f3a9830e Jul 25 23:09:04.327856 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1152508385 Jul 25 23:09:04.327856 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Role: reader,member Jul 25 23:09:04.327856 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Roles: reader,member Jul 25 23:09:04.329213 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/78f2a5cc4b7d4699ad5b00d3f3a9830e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/78f2a5cc4b7d4699ad5b00d3f3a9830e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_78f2a5cc4b7d4699ad5b00d3f3a9830e", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/78f2a5cc4b7d4699ad5b00d3f3a9830e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:09:04.329213 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-VolumesSnapshotTestJSON-1152508385 Jul 25 23:09:04.329213 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Id: 78f2a5cc4b7d4699ad5b00d3f3a9830e Jul 25 23:09:04.329213 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1152508385 Jul 25 23:09:04.329213 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User: tempest-VolumesSnapshotTestJSON-1152508385-project Jul 25 23:09:04.329213 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 25 23:09:04.329213 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 25 23:09:04.329213 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Id: ec45d64732fe4aac9fe6b9d6cd04a6f4 Jul 25 23:09:04.329213 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-VolumesSnapshotTestJSON-1152508385-project Jul 25 23:09:04.329213 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: method: > Jul 25 23:09:04.329213 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: exception: Instance fd5cd68d-b7c2-48c3-813a-337a6ba8472f could not be found. Jul 25 23:09:04.329213 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: action_args: {'id': 'fd5cd68d-b7c2-48c3-813a-337a6ba8472f'} Jul 25 23:09:04.329937 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:09:04.329937 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:09:04.329937 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:09:04.329937 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:09:04.329937 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:09:04.329937 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:09:04.329937 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:09:04.329937 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:09:04.329937 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:09:04.329937 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:09:04.329937 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd5cd68d-b7c2-48c3-813a-337a6ba8472f could not be found. Jul 25 23:09:04.329937 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:09:04.329937 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:09:04.329937 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:09:04.329937 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:09:04.329937 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:09:04.329937 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:09:04.329937 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:09:04.329937 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:09:04.329937 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:09:04.336023 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:09:04.336023 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 23:09:04.336023 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 23:09:04.336023 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:09:04.336023 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:09:04.336023 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:09:04.336023 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:09:04.336023 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd5cd68d-b7c2-48c3-813a-337a6ba8472f could not be found. Jul 25 23:09:04.336023 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:09:04.336023 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:09:04.336023 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:09:04.336023 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:09:04.336023 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:09:04.336023 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:09:04.336023 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:09:04.336023 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:09:04.336023 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd5cd68d-b7c2-48c3-813a-337a6ba8472f could not be found. Jul 25 23:09:04.336023 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:09:04.337087 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a43f64e2-1989-4875-b901-85783fa093ea tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] Returning 404 to user: Instance fd5cd68d-b7c2-48c3-813a-337a6ba8472f could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:09:04.337087 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a43f64e2-1989-4875-b901-85783fa093ea tempest-VolumesSnapshotTestJSON-1152508385 tempest-VolumesSnapshotTestJSON-1152508385-project] 10.222.0.55 "GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f" status: 404 len: 111 microversion: 2.1 time: 0.031547 Jul 25 23:09:04.337087 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 328/646] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:04 2022] GET /compute/v2.1/servers/fd5cd68d-b7c2-48c3-813a-337a6ba8472f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 23:09:04.348291 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-fbf65bf4-ec5a-4d29-97ce-a08d695fe7dc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:04.365945 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-fbf65bf4-ec5a-4d29-97ce-a08d695fe7dc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:04.365945 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-fbf65bf4-ec5a-4d29-97ce-a08d695fe7dc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:04.365945 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-fbf65bf4-ec5a-4d29-97ce-a08d695fe7dc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1599 microversion: 2.20 time: 0.257698 Jul 25 23:09:04.366641 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 319/647] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:09:04 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1599 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:09:04.387843 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-2556606d-1d8b-4730-83eb-111f9a6b166b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:04.388610 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-2556606d-1d8b-4730-83eb-111f9a6b166b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:04.396670 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2556606d-1d8b-4730-83eb-111f9a6b166b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:04.396670 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2556606d-1d8b-4730-83eb-111f9a6b166b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:04.397681 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2556606d-1d8b-4730-83eb-111f9a6b166b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:04.398284 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2556606d-1d8b-4730-83eb-111f9a6b166b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:04.520272 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-2556606d-1d8b-4730-83eb-111f9a6b166b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.137442 Jul 25 23:09:04.520880 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 329/648] 10.222.0.55 () {60 vars in 1316 bytes} [Mon Jul 25 23:09:04 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954/os-interface => generated 284 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 23:09:04.571312 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-57b5ed6a-650f-418e-8f27-2d4173381209 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:04.572032 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-57b5ed6a-650f-418e-8f27-2d4173381209 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:04.578872 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-57b5ed6a-650f-418e-8f27-2d4173381209 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:04.579313 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-57b5ed6a-650f-418e-8f27-2d4173381209 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:04.580114 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-57b5ed6a-650f-418e-8f27-2d4173381209 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:04.581094 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-57b5ed6a-650f-418e-8f27-2d4173381209 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:04.693177 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-57b5ed6a-650f-418e-8f27-2d4173381209 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:04.700528 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-57b5ed6a-650f-418e-8f27-2d4173381209 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9" status: 200 len: 1295 microversion: 2.1 time: 0.133220 Jul 25 23:09:04.710814 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 320/649] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:04 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9 => generated 1295 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:09:05.225852 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 23:09:05.226069 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Mon Jul 25 23:09:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 23:09:05.724289 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5e030352-c987-407c-bd88-84d2e78d55c0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:05.725068 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-5e030352-c987-407c-bd88-84d2e78d55c0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:05.732415 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5e030352-c987-407c-bd88-84d2e78d55c0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:05.733022 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5e030352-c987-407c-bd88-84d2e78d55c0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:05.733686 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5e030352-c987-407c-bd88-84d2e78d55c0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:05.734122 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5e030352-c987-407c-bd88-84d2e78d55c0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:06.105650 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-5e030352-c987-407c-bd88-84d2e78d55c0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:06.116916 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-5e030352-c987-407c-bd88-84d2e78d55c0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9" status: 200 len: 1363 microversion: 2.1 time: 0.396308 Jul 25 23:09:06.117922 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 330/650] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:05 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9 => generated 1363 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:09:06.292105 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-9dbc9476-48e0-4263-a2d0-ad4f3ba097dc req-bfa486f6-3172-4d5c-8aaa-466683131238 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5f69472-1864-4211-b288-44e579367954", "tag": "c6685a7a-bff1-4d27-8daf-0e1614096b58"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:09:06.303144 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-9dbc9476-48e0-4263-a2d0-ad4f3ba097dc req-bfa486f6-3172-4d5c-8aaa-466683131238 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:06.308349 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-9dbc9476-48e0-4263-a2d0-ad4f3ba097dc req-bfa486f6-3172-4d5c-8aaa-466683131238 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:06.319656 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-9dbc9476-48e0-4263-a2d0-ad4f3ba097dc req-bfa486f6-3172-4d5c-8aaa-466683131238 service nova] Creating event network-changed:c6685a7a-bff1-4d27-8daf-0e1614096b58 for instance c5f69472-1864-4211-b288-44e579367954 on hv-cinder-79760 Jul 25 23:09:06.326221 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-9dbc9476-48e0-4263-a2d0-ad4f3ba097dc req-bfa486f6-3172-4d5c-8aaa-466683131238 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037646 Jul 25 23:09:06.327444 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 321/651] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:09:07.139595 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a28b1f6f-6d26-4497-a8a9-ac995ec30f69 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:07.140870 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a28b1f6f-6d26-4497-a8a9-ac995ec30f69 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:07.149328 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a28b1f6f-6d26-4497-a8a9-ac995ec30f69 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:07.149906 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a28b1f6f-6d26-4497-a8a9-ac995ec30f69 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:07.150668 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a28b1f6f-6d26-4497-a8a9-ac995ec30f69 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:07.151100 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a28b1f6f-6d26-4497-a8a9-ac995ec30f69 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:07.302973 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a28b1f6f-6d26-4497-a8a9-ac995ec30f69 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:07.310871 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a28b1f6f-6d26-4497-a8a9-ac995ec30f69 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9" status: 200 len: 1363 microversion: 2.1 time: 0.175099 Jul 25 23:09:07.311454 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 331/652] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:07 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:09:08.344033 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-89d24e37-1e8a-4d03-81ba-3fb813a150cb req-404afe79-3f45-462f-af85-36864552a344 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccd6191d-8bbf-4ecb-803e-ca7e713501a9", "tag": "def0df55-c041-43a7-b482-7705b29f55d9"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:09:08.355438 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-89d24e37-1e8a-4d03-81ba-3fb813a150cb req-404afe79-3f45-462f-af85-36864552a344 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:08.355874 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-89d24e37-1e8a-4d03-81ba-3fb813a150cb req-404afe79-3f45-462f-af85-36864552a344 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:08.367658 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-89d24e37-1e8a-4d03-81ba-3fb813a150cb req-404afe79-3f45-462f-af85-36864552a344 service nova] Creating event network-changed:def0df55-c041-43a7-b482-7705b29f55d9 for instance ccd6191d-8bbf-4ecb-803e-ca7e713501a9 on hv-cinder-79760 Jul 25 23:09:08.377968 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-89d24e37-1e8a-4d03-81ba-3fb813a150cb req-404afe79-3f45-462f-af85-36864552a344 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032274 Jul 25 23:09:08.377968 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 332/653] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 23:09:08.456291 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-6e635fda-e2be-4ca3-bfb4-aeb1426f685f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:08.456964 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-6e635fda-e2be-4ca3-bfb4-aeb1426f685f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:08.463400 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6e635fda-e2be-4ca3-bfb4-aeb1426f685f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:08.463785 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6e635fda-e2be-4ca3-bfb4-aeb1426f685f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:08.464544 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6e635fda-e2be-4ca3-bfb4-aeb1426f685f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:08.464981 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6e635fda-e2be-4ca3-bfb4-aeb1426f685f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:08.603584 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-6e635fda-e2be-4ca3-bfb4-aeb1426f685f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:08.610890 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-6e635fda-e2be-4ca3-bfb4-aeb1426f685f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9" status: 200 len: 1363 microversion: 2.1 time: 0.282727 Jul 25 23:09:08.611444 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 322/654] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:08 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9 => generated 1363 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:09:09.635094 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e94d6ad5-50cd-430f-a6a0-2048f23abe40 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:09.636124 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e94d6ad5-50cd-430f-a6a0-2048f23abe40 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:09.648144 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e94d6ad5-50cd-430f-a6a0-2048f23abe40 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:09.648932 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e94d6ad5-50cd-430f-a6a0-2048f23abe40 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:09.650283 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e94d6ad5-50cd-430f-a6a0-2048f23abe40 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:09.651045 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e94d6ad5-50cd-430f-a6a0-2048f23abe40 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:09.850583 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e94d6ad5-50cd-430f-a6a0-2048f23abe40 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:09.854210 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:09:09.858637 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e94d6ad5-50cd-430f-a6a0-2048f23abe40 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9" status: 200 len: 1363 microversion: 2.1 time: 0.228849 Jul 25 23:09:09.859206 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 333/655] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:09 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9 => generated 1363 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:09:10.614876 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-f01a18ac-e7f2-4d90-b25f-639cb281b43e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:10.615354 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-f01a18ac-e7f2-4d90-b25f-639cb281b43e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:10.621960 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f01a18ac-e7f2-4d90-b25f-639cb281b43e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:10.622342 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f01a18ac-e7f2-4d90-b25f-639cb281b43e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:10.623106 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f01a18ac-e7f2-4d90-b25f-639cb281b43e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:10.623540 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f01a18ac-e7f2-4d90-b25f-639cb281b43e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:10.705447 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.objects.instance [None req-f01a18ac-e7f2-4d90-b25f-639cb281b43e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lazy-loading 'services' on Instance uuid 6b265736-7f3b-4414-a694-38120987bad8 {{(pid=118409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 23:09:10.881082 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6b26c74d-8170-4fe6-bc63-2d8bde334d94 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:10.881707 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6b26c74d-8170-4fe6-bc63-2d8bde334d94 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:10.888591 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6b26c74d-8170-4fe6-bc63-2d8bde334d94 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:10.889048 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6b26c74d-8170-4fe6-bc63-2d8bde334d94 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:10.889992 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6b26c74d-8170-4fe6-bc63-2d8bde334d94 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:10.890336 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6b26c74d-8170-4fe6-bc63-2d8bde334d94 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:10.926036 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-f01a18ac-e7f2-4d90-b25f-639cb281b43e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8/os-volume_attachments/9d959db9-b729-4321-b55e-5535532598a7" status: 202 len: 0 microversion: 2.1 time: 0.314876 Jul 25 23:09:10.926540 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 323/656] 10.222.0.55 () {58 vars in 1416 bytes} [Mon Jul 25 23:09:10 2022] DELETE /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8/os-volume_attachments/9d959db9-b729-4321-b55e-5535532598a7 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 23:09:10.935527 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-c2275913-da9e-4774-93e3-99b4005ac63b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:10.938032 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-c2275913-da9e-4774-93e3-99b4005ac63b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:10.945227 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c2275913-da9e-4774-93e3-99b4005ac63b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:10.946245 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c2275913-da9e-4774-93e3-99b4005ac63b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:10.947008 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c2275913-da9e-4774-93e3-99b4005ac63b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:10.947442 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c2275913-da9e-4774-93e3-99b4005ac63b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:10.980505 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-c2275913-da9e-4774-93e3-99b4005ac63b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049378 Jul 25 23:09:10.981067 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 324/657] 10.222.0.55 () {58 vars in 1302 bytes} [Mon Jul 25 23:09:10 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 23:09:11.032969 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6b26c74d-8170-4fe6-bc63-2d8bde334d94 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:11.040620 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6b26c74d-8170-4fe6-bc63-2d8bde334d94 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9" status: 200 len: 1363 microversion: 2.1 time: 0.164617 Jul 25 23:09:11.044810 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 334/658] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:10 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:09:11.992821 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-37b2f0de-acb2-484c-932f-1564320b3285 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:11.994976 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-37b2f0de-acb2-484c-932f-1564320b3285 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:11.996956 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell0:SELECT=2 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:09:11.997841 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell0:SELECT=10 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:09:12.003358 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-37b2f0de-acb2-484c-932f-1564320b3285 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:12.003831 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-37b2f0de-acb2-484c-932f-1564320b3285 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:12.004594 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-37b2f0de-acb2-484c-932f-1564320b3285 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:12.005026 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-37b2f0de-acb2-484c-932f-1564320b3285 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:12.036686 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-37b2f0de-acb2-484c-932f-1564320b3285 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048264 Jul 25 23:09:12.037210 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 325/659] 10.222.0.55 () {58 vars in 1302 bytes} [Mon Jul 25 23:09:11 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:09:12.062127 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-58ea6a6b-c647-4cdf-817a-27348dafe875 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:12.062730 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-58ea6a6b-c647-4cdf-817a-27348dafe875 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:12.064684 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=2 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:09:12.070489 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-58ea6a6b-c647-4cdf-817a-27348dafe875 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:12.070932 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-58ea6a6b-c647-4cdf-817a-27348dafe875 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:12.072418 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-58ea6a6b-c647-4cdf-817a-27348dafe875 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:12.072418 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-58ea6a6b-c647-4cdf-817a-27348dafe875 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:12.207983 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-58ea6a6b-c647-4cdf-817a-27348dafe875 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:12.215926 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-58ea6a6b-c647-4cdf-817a-27348dafe875 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9" status: 200 len: 1363 microversion: 2.1 time: 0.157717 Jul 25 23:09:12.216670 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 335/660] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:12 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:09:13.050793 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-9861647a-478c-427e-8e92-35f5557da513 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:13.052976 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-9861647a-478c-427e-8e92-35f5557da513 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:13.060206 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9861647a-478c-427e-8e92-35f5557da513 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:13.063165 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9861647a-478c-427e-8e92-35f5557da513 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:13.063165 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9861647a-478c-427e-8e92-35f5557da513 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:13.063165 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9861647a-478c-427e-8e92-35f5557da513 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:13.090444 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-9861647a-478c-427e-8e92-35f5557da513 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044946 Jul 25 23:09:13.090999 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 326/661] 10.222.0.55 () {58 vars in 1302 bytes} [Mon Jul 25 23:09:13 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 23:09:13.169736 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-77e4a21a-af48-4099-bf78-7820fb632c47 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:13.170260 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-77e4a21a-af48-4099-bf78-7820fb632c47 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:13.178527 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-77e4a21a-af48-4099-bf78-7820fb632c47 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:13.178969 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-77e4a21a-af48-4099-bf78-7820fb632c47 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:13.179726 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-77e4a21a-af48-4099-bf78-7820fb632c47 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:13.180149 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-77e4a21a-af48-4099-bf78-7820fb632c47 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:13.208852 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-77e4a21a-af48-4099-bf78-7820fb632c47 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Going to try to terminate instance {{(pid=118410) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 23:09:13.238805 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-118a2ddb-d0f4-4a5f-81fe-f9489f05242a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:13.239137 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-118a2ddb-d0f4-4a5f-81fe-f9489f05242a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:13.245876 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-118a2ddb-d0f4-4a5f-81fe-f9489f05242a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:13.246321 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-118a2ddb-d0f4-4a5f-81fe-f9489f05242a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:13.247090 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-118a2ddb-d0f4-4a5f-81fe-f9489f05242a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:13.247539 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-118a2ddb-d0f4-4a5f-81fe-f9489f05242a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:13.379730 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-118a2ddb-d0f4-4a5f-81fe-f9489f05242a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:13.387415 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-118a2ddb-d0f4-4a5f-81fe-f9489f05242a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9" status: 200 len: 1363 microversion: 2.1 time: 0.153096 Jul 25 23:09:13.388011 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 327/662] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:13 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:09:13.526157 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-77e4a21a-af48-4099-bf78-7820fb632c47 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 204 len: 0 microversion: 2.1 time: 0.360002 Jul 25 23:09:13.527008 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 336/663] 10.222.0.55 () {58 vars in 1239 bytes} [Mon Jul 25 23:09:13 2022] DELETE /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 23:09:13.535212 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-e5095518-2b94-4416-ba7e-3a7799dbd337 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:13.535820 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-e5095518-2b94-4416-ba7e-3a7799dbd337 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:13.542066 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e5095518-2b94-4416-ba7e-3a7799dbd337 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:13.542508 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e5095518-2b94-4416-ba7e-3a7799dbd337 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:13.543292 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e5095518-2b94-4416-ba7e-3a7799dbd337 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:13.543717 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e5095518-2b94-4416-ba7e-3a7799dbd337 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:13.682709 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-e5095518-2b94-4416-ba7e-3a7799dbd337 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:13.695024 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-e5095518-2b94-4416-ba7e-3a7799dbd337 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1687 microversion: 2.1 time: 0.163955 Jul 25 23:09:13.695617 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 328/664] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:13 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1687 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:09:14.409908 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a88e47d7-cca2-4fdb-92e7-7abbdbadc507 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:14.410646 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a88e47d7-cca2-4fdb-92e7-7abbdbadc507 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:14.417303 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a88e47d7-cca2-4fdb-92e7-7abbdbadc507 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:14.417749 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a88e47d7-cca2-4fdb-92e7-7abbdbadc507 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:14.429364 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a88e47d7-cca2-4fdb-92e7-7abbdbadc507 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:14.429364 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a88e47d7-cca2-4fdb-92e7-7abbdbadc507 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:14.552904 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a88e47d7-cca2-4fdb-92e7-7abbdbadc507 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:14.560483 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a88e47d7-cca2-4fdb-92e7-7abbdbadc507 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9" status: 200 len: 1363 microversion: 2.1 time: 0.154961 Jul 25 23:09:14.563810 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 337/665] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:14 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:09:14.716182 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-5b0dfb1b-98b1-4ab9-9ed4-9070b865bd68 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:14.716720 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-5b0dfb1b-98b1-4ab9-9ed4-9070b865bd68 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:14.723692 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5b0dfb1b-98b1-4ab9-9ed4-9070b865bd68 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:14.724142 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5b0dfb1b-98b1-4ab9-9ed4-9070b865bd68 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:14.724907 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5b0dfb1b-98b1-4ab9-9ed4-9070b865bd68 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:14.725369 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5b0dfb1b-98b1-4ab9-9ed4-9070b865bd68 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:14.858912 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-5b0dfb1b-98b1-4ab9-9ed4-9070b865bd68 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:14.867029 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-5b0dfb1b-98b1-4ab9-9ed4-9070b865bd68 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1687 microversion: 2.1 time: 0.154846 Jul 25 23:09:14.867597 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 329/666] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:14 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:09:15.581883 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-486ac3eb-3551-45d7-bc1e-b88edaa89b7c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:15.583070 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-486ac3eb-3551-45d7-bc1e-b88edaa89b7c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:15.588808 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-486ac3eb-3551-45d7-bc1e-b88edaa89b7c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:15.589278 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-486ac3eb-3551-45d7-bc1e-b88edaa89b7c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:15.590049 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-486ac3eb-3551-45d7-bc1e-b88edaa89b7c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:15.590544 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-486ac3eb-3551-45d7-bc1e-b88edaa89b7c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:15.697058 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-144d1dc2-3920-4348-8d2e-bdfaad11199e req-9d430846-c9f3-4dcb-b1f4-caed06cdc12c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccd6191d-8bbf-4ecb-803e-ca7e713501a9", "name": "network-vif-plugged", "status": "completed", "tag": "def0df55-c041-43a7-b482-7705b29f55d9"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:09:15.709908 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-144d1dc2-3920-4348-8d2e-bdfaad11199e req-9d430846-c9f3-4dcb-b1f4-caed06cdc12c service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:15.710389 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-144d1dc2-3920-4348-8d2e-bdfaad11199e req-9d430846-c9f3-4dcb-b1f4-caed06cdc12c service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:15.722827 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-144d1dc2-3920-4348-8d2e-bdfaad11199e req-9d430846-c9f3-4dcb-b1f4-caed06cdc12c service nova] Creating event network-vif-plugged:def0df55-c041-43a7-b482-7705b29f55d9 for instance ccd6191d-8bbf-4ecb-803e-ca7e713501a9 on hv-cinder-79760 Jul 25 23:09:15.727755 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-144d1dc2-3920-4348-8d2e-bdfaad11199e req-9d430846-c9f3-4dcb-b1f4-caed06cdc12c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037750 Jul 25 23:09:15.731238 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 330/667] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:09:15.752909 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-486ac3eb-3551-45d7-bc1e-b88edaa89b7c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:15.760949 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-486ac3eb-3551-45d7-bc1e-b88edaa89b7c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9" status: 200 len: 1363 microversion: 2.1 time: 0.182928 Jul 25 23:09:15.763002 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 338/668] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:15 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:09:15.889965 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-544fedf9-da5b-4e2a-81b2-f12f2999d89f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:15.890687 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-544fedf9-da5b-4e2a-81b2-f12f2999d89f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:15.897298 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-544fedf9-da5b-4e2a-81b2-f12f2999d89f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:15.897747 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-544fedf9-da5b-4e2a-81b2-f12f2999d89f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:15.902135 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-544fedf9-da5b-4e2a-81b2-f12f2999d89f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:15.902135 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-544fedf9-da5b-4e2a-81b2-f12f2999d89f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:16.032424 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-544fedf9-da5b-4e2a-81b2-f12f2999d89f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:16.040545 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-544fedf9-da5b-4e2a-81b2-f12f2999d89f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1687 microversion: 2.1 time: 0.154907 Jul 25 23:09:16.041134 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 331/669] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:15 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:09:16.782324 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a80c3b7d-8160-4f18-9e71-cf0bdb94ee6a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:16.782887 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a80c3b7d-8160-4f18-9e71-cf0bdb94ee6a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:16.791143 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a80c3b7d-8160-4f18-9e71-cf0bdb94ee6a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:16.791871 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a80c3b7d-8160-4f18-9e71-cf0bdb94ee6a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:16.793146 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a80c3b7d-8160-4f18-9e71-cf0bdb94ee6a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:16.793888 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a80c3b7d-8160-4f18-9e71-cf0bdb94ee6a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:16.940312 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a80c3b7d-8160-4f18-9e71-cf0bdb94ee6a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:16.948460 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a80c3b7d-8160-4f18-9e71-cf0bdb94ee6a tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9" status: 200 len: 1363 microversion: 2.1 time: 0.170212 Jul 25 23:09:16.949033 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 339/670] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:16 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9 => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:09:17.062556 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-9040548f-37d4-46cb-acca-0677261be597 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:17.063079 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-9040548f-37d4-46cb-acca-0677261be597 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:17.070566 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9040548f-37d4-46cb-acca-0677261be597 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:17.071011 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9040548f-37d4-46cb-acca-0677261be597 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:17.071778 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9040548f-37d4-46cb-acca-0677261be597 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:17.072213 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9040548f-37d4-46cb-acca-0677261be597 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:17.209151 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-9040548f-37d4-46cb-acca-0677261be597 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:17.216623 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-9040548f-37d4-46cb-acca-0677261be597 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1687 microversion: 2.1 time: 0.158002 Jul 25 23:09:17.217208 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 332/671] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:17 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:09:17.975813 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-ac301462-4de3-497b-939a-c70cdb3400cf tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:17.976413 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-ac301462-4de3-497b-939a-c70cdb3400cf tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:17.983032 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ac301462-4de3-497b-939a-c70cdb3400cf tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:17.983477 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ac301462-4de3-497b-939a-c70cdb3400cf tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:17.984236 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ac301462-4de3-497b-939a-c70cdb3400cf tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:17.984670 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ac301462-4de3-497b-939a-c70cdb3400cf tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:18.117374 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ac301462-4de3-497b-939a-c70cdb3400cf tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:18.124845 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-ac301462-4de3-497b-939a-c70cdb3400cf tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9" status: 200 len: 1363 microversion: 2.1 time: 0.153497 Jul 25 23:09:18.125458 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 340/672] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:17 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:09:18.237432 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-b84e4dd4-88a2-4966-aa07-644954f4b4c4 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:18.238047 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-b84e4dd4-88a2-4966-aa07-644954f4b4c4 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:18.245078 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b84e4dd4-88a2-4966-aa07-644954f4b4c4 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:18.245550 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b84e4dd4-88a2-4966-aa07-644954f4b4c4 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:18.246298 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b84e4dd4-88a2-4966-aa07-644954f4b4c4 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:18.246724 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b84e4dd4-88a2-4966-aa07-644954f4b4c4 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:18.377444 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-b84e4dd4-88a2-4966-aa07-644954f4b4c4 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:18.385223 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-b84e4dd4-88a2-4966-aa07-644954f4b4c4 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1687 microversion: 2.1 time: 0.151491 Jul 25 23:09:18.385804 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 333/673] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:18 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1687 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:09:19.145672 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-157fde40-25d3-4df2-926f-720b07a8e8f6 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:19.147338 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-157fde40-25d3-4df2-926f-720b07a8e8f6 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:19.154265 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-157fde40-25d3-4df2-926f-720b07a8e8f6 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:19.154706 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-157fde40-25d3-4df2-926f-720b07a8e8f6 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:19.155466 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-157fde40-25d3-4df2-926f-720b07a8e8f6 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:19.155890 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-157fde40-25d3-4df2-926f-720b07a8e8f6 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:19.324316 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-157fde40-25d3-4df2-926f-720b07a8e8f6 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:19.332605 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-157fde40-25d3-4df2-926f-720b07a8e8f6 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9" status: 200 len: 1363 microversion: 2.1 time: 0.190794 Jul 25 23:09:19.335103 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 341/674] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:19 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9 => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:09:19.406857 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-414d4d9c-9b51-4a83-a803-b57dda41364b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:19.407377 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-414d4d9c-9b51-4a83-a803-b57dda41364b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:19.415416 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-414d4d9c-9b51-4a83-a803-b57dda41364b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:19.415854 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-414d4d9c-9b51-4a83-a803-b57dda41364b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:19.416614 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-414d4d9c-9b51-4a83-a803-b57dda41364b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:19.417041 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-414d4d9c-9b51-4a83-a803-b57dda41364b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:19.551007 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-414d4d9c-9b51-4a83-a803-b57dda41364b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:19.558804 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-414d4d9c-9b51-4a83-a803-b57dda41364b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1687 microversion: 2.1 time: 0.155953 Jul 25 23:09:19.559377 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 334/675] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:19 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:09:20.222342 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-7bf2482d-0258-4afd-a88b-c74556f00c4c req-e3504a45-ba0b-41e8-941b-c88429af424a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b265736-7f3b-4414-a694-38120987bad8", "name": "network-vif-deleted", "tag": "e1b7bf8a-034c-4009-9dae-e893018ee8ee"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:09:20.233106 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-7bf2482d-0258-4afd-a88b-c74556f00c4c req-e3504a45-ba0b-41e8-941b-c88429af424a service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:20.234379 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-7bf2482d-0258-4afd-a88b-c74556f00c4c req-e3504a45-ba0b-41e8-941b-c88429af424a service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:20.248549 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-7bf2482d-0258-4afd-a88b-c74556f00c4c req-e3504a45-ba0b-41e8-941b-c88429af424a service nova] Creating event network-vif-deleted:e1b7bf8a-034c-4009-9dae-e893018ee8ee for instance 6b265736-7f3b-4414-a694-38120987bad8 on hv-cinder-79760 Jul 25 23:09:20.253833 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-7bf2482d-0258-4afd-a88b-c74556f00c4c req-e3504a45-ba0b-41e8-941b-c88429af424a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034794 Jul 25 23:09:20.257746 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 342/676] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:09:20.356028 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-5f70ec17-8eed-40b6-983e-e82800e6c616 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:20.356647 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-5f70ec17-8eed-40b6-983e-e82800e6c616 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:20.372125 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5f70ec17-8eed-40b6-983e-e82800e6c616 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:20.372125 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5f70ec17-8eed-40b6-983e-e82800e6c616 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:20.372125 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5f70ec17-8eed-40b6-983e-e82800e6c616 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:20.372125 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5f70ec17-8eed-40b6-983e-e82800e6c616 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:20.387584 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:09:20.550615 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-5f70ec17-8eed-40b6-983e-e82800e6c616 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:20.559086 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-5f70ec17-8eed-40b6-983e-e82800e6c616 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9" status: 200 len: 1363 microversion: 2.1 time: 0.208280 Jul 25 23:09:20.559669 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 335/677] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:20 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9 => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:09:20.580270 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-7db0d1ee-466d-44cb-adec-e75774262dfe tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:20.584925 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-7db0d1ee-466d-44cb-adec-e75774262dfe tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:20.587685 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7db0d1ee-466d-44cb-adec-e75774262dfe tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:20.588126 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7db0d1ee-466d-44cb-adec-e75774262dfe tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:20.589281 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7db0d1ee-466d-44cb-adec-e75774262dfe tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:20.589713 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7db0d1ee-466d-44cb-adec-e75774262dfe tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:20.663170 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7db0d1ee-466d-44cb-adec-e75774262dfe tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:20.671081 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-7db0d1ee-466d-44cb-adec-e75774262dfe tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1327 microversion: 2.1 time: 0.094885 Jul 25 23:09:20.672086 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 343/678] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:20 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1327 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:09:21.579984 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-015d6d6f-faf5-47aa-a902-14db631a61a2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:21.580594 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-015d6d6f-faf5-47aa-a902-14db631a61a2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:21.588559 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-015d6d6f-faf5-47aa-a902-14db631a61a2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:21.589002 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-015d6d6f-faf5-47aa-a902-14db631a61a2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:21.589823 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-015d6d6f-faf5-47aa-a902-14db631a61a2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:21.590624 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-015d6d6f-faf5-47aa-a902-14db631a61a2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:21.691903 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-89865a39-d30c-4279-a8e2-8d950bf3453d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:21.693400 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-89865a39-d30c-4279-a8e2-8d950bf3453d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:21.700040 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-89865a39-d30c-4279-a8e2-8d950bf3453d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:21.700517 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-89865a39-d30c-4279-a8e2-8d950bf3453d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:21.703788 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-89865a39-d30c-4279-a8e2-8d950bf3453d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:21.703788 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-89865a39-d30c-4279-a8e2-8d950bf3453d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:21.733783 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-89865a39-d30c-4279-a8e2-8d950bf3453d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:21.734236 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-89865a39-d30c-4279-a8e2-8d950bf3453d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:21.734685 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.objects.instance [None req-89865a39-d30c-4279-a8e2-8d950bf3453d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lazy-loading 'fault' on Instance uuid 6b265736-7f3b-4414-a694-38120987bad8 {{(pid=118410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 23:09:21.735643 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-015d6d6f-faf5-47aa-a902-14db631a61a2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:21.743807 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-015d6d6f-faf5-47aa-a902-14db631a61a2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9" status: 200 len: 1550 microversion: 2.1 time: 0.168053 Jul 25 23:09:21.744381 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 336/679] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:21 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9 => generated 1550 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:09:21.764569 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-053a5499-b04a-4658-837e-7a30820d50d0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:21.765057 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-053a5499-b04a-4658-837e-7a30820d50d0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:21.771086 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-053a5499-b04a-4658-837e-7a30820d50d0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:21.771529 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-053a5499-b04a-4658-837e-7a30820d50d0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:21.772562 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-053a5499-b04a-4658-837e-7a30820d50d0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:21.772984 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-053a5499-b04a-4658-837e-7a30820d50d0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:21.783115 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-89865a39-d30c-4279-a8e2-8d950bf3453d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:21.791599 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-89865a39-d30c-4279-a8e2-8d950bf3453d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 200 len: 1332 microversion: 2.1 time: 0.103610 Jul 25 23:09:21.792761 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 344/680] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:21 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 1332 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:09:21.862520 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-053a5499-b04a-4658-837e-7a30820d50d0 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101671 Jul 25 23:09:21.863096 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 337/681] 10.222.0.55 () {58 vars in 1275 bytes} [Mon Jul 25 23:09:21 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 23:09:22.822434 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e76cca74-787c-408b-a2c1-78a8b8f2d21f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:22.823031 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e76cca74-787c-408b-a2c1-78a8b8f2d21f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: 6b265736-7f3b-4414-a694-38120987bad8] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:22.829728 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e76cca74-787c-408b-a2c1-78a8b8f2d21f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:22.830217 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e76cca74-787c-408b-a2c1-78a8b8f2d21f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:22.830965 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e76cca74-787c-408b-a2c1-78a8b8f2d21f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:22.831390 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e76cca74-787c-408b-a2c1-78a8b8f2d21f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:22.846036 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-e76cca74-787c-408b-a2c1-78a8b8f2d21f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] HTTP exception thrown: Instance 6b265736-7f3b-4414-a694-38120987bad8 could not be found. Jul 25 23:09:22.847764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e76cca74-787c-408b-a2c1-78a8b8f2d21f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Request method failure captured: Jul 25 23:09:22.847764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 HTTP/1.1 Jul 25 23:09:22.847764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 25 23:09:22.847764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 25 23:09:22.847764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Connection: close Jul 25 23:09:22.847764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 25 23:09:22.847764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 25 23:09:22.847764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Host: 10.222.0.55 Jul 25 23:09:22.847764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 25 23:09:22.847764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.10 Jul 25 23:09:22.847764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABi3yFhkq942vbXnch_IaDKYkO2a3M4yfpDeC2Egpsw0NkwonPh9rBHysX1VIkRqYsB6WQirLUD5WvUZeDdUAXg7TkjmCnSiBSzeoce0TNVhD0leQwr5enAPBpaGFXzPzZMM9NzAOwUv2fBV_BWwBxc9go1JkJZo0Dfjd7PPELR0ji1dFs Jul 25 23:09:22.847764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 25 23:09:22.847764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 25 23:09:22.847764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 25 23:09:22.847764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 25 23:09:22.847764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 25 23:09:22.847764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 25 23:09:22.847764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Id: d37d3446345749b28d847313e1e6c488 Jul 25 23:09:22.847764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1178072060 Jul 25 23:09:22.847764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Role: reader,member Jul 25 23:09:22.847764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Roles: reader,member Jul 25 23:09:22.849701 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d37d3446345749b28d847313e1e6c488"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d37d3446345749b28d847313e1e6c488"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d37d3446345749b28d847313e1e6c488", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d37d3446345749b28d847313e1e6c488"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:09:22.849701 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1178072060 Jul 25 23:09:22.849701 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Id: d37d3446345749b28d847313e1e6c488 Jul 25 23:09:22.849701 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1178072060 Jul 25 23:09:22.849701 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User: tempest-ServerRescueNegativeTestJSON-1178072060-project Jul 25 23:09:22.849701 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 25 23:09:22.849701 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 25 23:09:22.849701 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Id: 61d3b5a3082a4c74a2a08007581388c0 Jul 25 23:09:22.849701 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1178072060-project Jul 25 23:09:22.849701 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: method: > Jul 25 23:09:22.849701 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: exception: Instance 6b265736-7f3b-4414-a694-38120987bad8 could not be found. Jul 25 23:09:22.849701 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: action_args: {'id': '6b265736-7f3b-4414-a694-38120987bad8'} Jul 25 23:09:22.853769 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:09:22.853769 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:09:22.853769 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:09:22.853769 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:09:22.853769 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:09:22.853769 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:09:22.853769 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:09:22.853769 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:09:22.853769 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:09:22.853769 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:09:22.853769 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b265736-7f3b-4414-a694-38120987bad8 could not be found. Jul 25 23:09:22.853769 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:09:22.853769 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:09:22.853769 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:09:22.853769 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:09:22.853769 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:09:22.853769 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:09:22.853769 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:09:22.853769 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:09:22.853769 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:09:22.855354 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:09:22.855354 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 23:09:22.855354 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 23:09:22.855354 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:09:22.855354 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:09:22.855354 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:09:22.855354 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:09:22.855354 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b265736-7f3b-4414-a694-38120987bad8 could not be found. Jul 25 23:09:22.855354 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:09:22.855354 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:09:22.855354 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:09:22.855354 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:09:22.855354 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:09:22.855354 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:09:22.855354 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:09:22.855354 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:09:22.855354 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b265736-7f3b-4414-a694-38120987bad8 could not be found. Jul 25 23:09:22.855354 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:09:22.856661 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e76cca74-787c-408b-a2c1-78a8b8f2d21f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Returning 404 to user: Instance 6b265736-7f3b-4414-a694-38120987bad8 could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:09:22.856661 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e76cca74-787c-408b-a2c1-78a8b8f2d21f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8" status: 404 len: 111 microversion: 2.1 time: 0.030756 Jul 25 23:09:22.856661 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 345/682] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:22 2022] GET /compute/v2.1/servers/6b265736-7f3b-4414-a694-38120987bad8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:09:22.863138 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-ecb8e3ff-85d5-49da-b419-7516f8a8a881 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '.version_select at 0x7f622f7b3820>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:22.983677 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-ecb8e3ff-85d5-49da-b419-7516f8a8a881 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-193804980" status: 202 len: 0 microversion: 2.1 time: 0.125393 Jul 25 23:09:22.984384 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 338/683] 10.222.0.55 () {58 vars in 1218 bytes} [Mon Jul 25 23:09:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-193804980 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 23:09:23.167408 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-ddf6d636-9380-4207-8d44-189959a88258 req-e2062163-05cb-4280-bc22-2238dae0c02f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ccd6191d-8bbf-4ecb-803e-ca7e713501a9", "tag": "def0df55-c041-43a7-b482-7705b29f55d9"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:09:23.178747 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-ddf6d636-9380-4207-8d44-189959a88258 req-e2062163-05cb-4280-bc22-2238dae0c02f service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:23.179526 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-ddf6d636-9380-4207-8d44-189959a88258 req-e2062163-05cb-4280-bc22-2238dae0c02f service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:23.192020 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-ddf6d636-9380-4207-8d44-189959a88258 req-e2062163-05cb-4280-bc22-2238dae0c02f service nova] Creating event network-changed:def0df55-c041-43a7-b482-7705b29f55d9 for instance ccd6191d-8bbf-4ecb-803e-ca7e713501a9 on hv-cinder-79760 Jul 25 23:09:23.197717 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-ddf6d636-9380-4207-8d44-189959a88258 req-e2062163-05cb-4280-bc22-2238dae0c02f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034003 Jul 25 23:09:23.198543 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 346/684] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 23:09:26.756315 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-4b5b0c07-3ed5-49d9-98c7-7968f8fee544 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:26.756804 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-4b5b0c07-3ed5-49d9-98c7-7968f8fee544 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:26.763628 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4b5b0c07-3ed5-49d9-98c7-7968f8fee544 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:26.764060 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4b5b0c07-3ed5-49d9-98c7-7968f8fee544 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:26.764816 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4b5b0c07-3ed5-49d9-98c7-7968f8fee544 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:26.765277 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4b5b0c07-3ed5-49d9-98c7-7968f8fee544 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:26.789530 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-4b5b0c07-3ed5-49d9-98c7-7968f8fee544 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Going to try to terminate instance {{(pid=118409) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 23:09:27.113151 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-4b5b0c07-3ed5-49d9-98c7-7968f8fee544 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "DELETE /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 204 len: 0 microversion: 2.1 time: 0.361516 Jul 25 23:09:27.113674 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 339/685] 10.222.0.55 () {58 vars in 1239 bytes} [Mon Jul 25 23:09:26 2022] DELETE /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 23:09:27.122946 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-7a87252c-3cd9-42fb-abd9-cba1f80b5472 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:27.123638 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-7a87252c-3cd9-42fb-abd9-cba1f80b5472 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:27.130223 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7a87252c-3cd9-42fb-abd9-cba1f80b5472 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:27.130669 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7a87252c-3cd9-42fb-abd9-cba1f80b5472 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:27.131428 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7a87252c-3cd9-42fb-abd9-cba1f80b5472 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:27.131861 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7a87252c-3cd9-42fb-abd9-cba1f80b5472 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:27.263942 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7a87252c-3cd9-42fb-abd9-cba1f80b5472 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:27.272885 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-7a87252c-3cd9-42fb-abd9-cba1f80b5472 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1507 microversion: 2.1 time: 0.154101 Jul 25 23:09:27.273490 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 347/686] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:27 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:09:28.295508 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-a6df78e7-c1e4-4759-86fd-73ac39c31915 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:28.296196 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-a6df78e7-c1e4-4759-86fd-73ac39c31915 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:28.302808 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a6df78e7-c1e4-4759-86fd-73ac39c31915 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:28.303260 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a6df78e7-c1e4-4759-86fd-73ac39c31915 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:28.306432 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a6df78e7-c1e4-4759-86fd-73ac39c31915 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:28.306432 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a6df78e7-c1e4-4759-86fd-73ac39c31915 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:28.439882 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-a6df78e7-c1e4-4759-86fd-73ac39c31915 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:28.448994 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-a6df78e7-c1e4-4759-86fd-73ac39c31915 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1507 microversion: 2.1 time: 0.157691 Jul 25 23:09:28.449594 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 340/687] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:28 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:09:29.470627 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-16e9dd92-db3d-41ba-8924-0824dc01745e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:29.471234 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-16e9dd92-db3d-41ba-8924-0824dc01745e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:29.478484 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-16e9dd92-db3d-41ba-8924-0824dc01745e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:29.478966 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-16e9dd92-db3d-41ba-8924-0824dc01745e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:29.479742 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-16e9dd92-db3d-41ba-8924-0824dc01745e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:29.480180 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-16e9dd92-db3d-41ba-8924-0824dc01745e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:29.615184 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-16e9dd92-db3d-41ba-8924-0824dc01745e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:29.623125 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-16e9dd92-db3d-41ba-8924-0824dc01745e tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1507 microversion: 2.1 time: 0.156322 Jul 25 23:09:29.623693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 348/688] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:29 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:09:30.191395 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-1ac43cc4-0b67-4097-bc40-33dec570a00d req-e1b2c917-d9ba-4a7f-869f-cb37e78a79d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad", "name": "network-vif-deleted", "tag": "2dda7df4-b839-4b39-8a4c-076a67b464e7"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:09:30.203314 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-1ac43cc4-0b67-4097-bc40-33dec570a00d req-e1b2c917-d9ba-4a7f-869f-cb37e78a79d6 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:30.203314 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-1ac43cc4-0b67-4097-bc40-33dec570a00d req-e1b2c917-d9ba-4a7f-869f-cb37e78a79d6 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:30.216306 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-1ac43cc4-0b67-4097-bc40-33dec570a00d req-e1b2c917-d9ba-4a7f-869f-cb37e78a79d6 service nova] Creating event network-vif-deleted:2dda7df4-b839-4b39-8a4c-076a67b464e7 for instance be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad on hv-cinder-79760 Jul 25 23:09:30.223609 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-1ac43cc4-0b67-4097-bc40-33dec570a00d req-e1b2c917-d9ba-4a7f-869f-cb37e78a79d6 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092881 Jul 25 23:09:30.224221 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 341/689] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:09:30.644817 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-63747dab-526e-423f-8b47-e4e678b75350 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:30.646525 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-63747dab-526e-423f-8b47-e4e678b75350 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:30.653074 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-63747dab-526e-423f-8b47-e4e678b75350 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:30.653563 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-63747dab-526e-423f-8b47-e4e678b75350 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:30.654327 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-63747dab-526e-423f-8b47-e4e678b75350 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:30.662069 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-63747dab-526e-423f-8b47-e4e678b75350 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:30.688380 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-63747dab-526e-423f-8b47-e4e678b75350 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:30.689598 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-63747dab-526e-423f-8b47-e4e678b75350 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:30.689598 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.objects.instance [None req-63747dab-526e-423f-8b47-e4e678b75350 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lazy-loading 'fault' on Instance uuid be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad {{(pid=118410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 23:09:30.732446 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-63747dab-526e-423f-8b47-e4e678b75350 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:30.740753 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-63747dab-526e-423f-8b47-e4e678b75350 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 200 len: 1311 microversion: 2.1 time: 0.099746 Jul 25 23:09:30.741373 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 349/690] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:30 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:09:31.762512 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-2f9fa34a-1e50-4a39-bf76-cb738580328d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:31.763200 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-2f9fa34a-1e50-4a39-bf76-cb738580328d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:31.769380 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2f9fa34a-1e50-4a39-bf76-cb738580328d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:31.770696 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2f9fa34a-1e50-4a39-bf76-cb738580328d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:31.771187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2f9fa34a-1e50-4a39-bf76-cb738580328d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:31.771888 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2f9fa34a-1e50-4a39-bf76-cb738580328d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:31.785356 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.wsgi [None req-2f9fa34a-1e50-4a39-bf76-cb738580328d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] HTTP exception thrown: Instance be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad could not be found. Jul 25 23:09:31.787156 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-2f9fa34a-1e50-4a39-bf76-cb738580328d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Request method failure captured: Jul 25 23:09:31.787156 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: request: GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad HTTP/1.1 Jul 25 23:09:31.787156 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept: application/json Jul 25 23:09:31.787156 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept-Encoding: identity Jul 25 23:09:31.787156 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Connection: close Jul 25 23:09:31.787156 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Length: 0 Jul 25 23:09:31.787156 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Type: application/json Jul 25 23:09:31.787156 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Host: 10.222.0.55 Jul 25 23:09:31.787156 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Openstack-System-Scope: None Jul 25 23:09:31.787156 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: User-Agent: python-urllib3/1.26.10 Jul 25 23:09:31.787156 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Auth-Token: gAAAAABi3yFhkq942vbXnch_IaDKYkO2a3M4yfpDeC2Egpsw0NkwonPh9rBHysX1VIkRqYsB6WQirLUD5WvUZeDdUAXg7TkjmCnSiBSzeoce0TNVhD0leQwr5enAPBpaGFXzPzZMM9NzAOwUv2fBV_BWwBxc9go1JkJZo0Dfjd7PPELR0ji1dFs Jul 25 23:09:31.787156 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Id: None Jul 25 23:09:31.787156 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Name: None Jul 25 23:09:31.787156 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Identity-Status: Confirmed Jul 25 23:09:31.787156 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Is-Admin-Project: True Jul 25 23:09:31.787156 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Id: default Jul 25 23:09:31.787156 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Name: Default Jul 25 23:09:31.787156 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Id: d37d3446345749b28d847313e1e6c488 Jul 25 23:09:31.787156 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1178072060 Jul 25 23:09:31.787156 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Role: reader,member Jul 25 23:09:31.787156 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Roles: reader,member Jul 25 23:09:31.788615 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d37d3446345749b28d847313e1e6c488"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d37d3446345749b28d847313e1e6c488"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d37d3446345749b28d847313e1e6c488", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d37d3446345749b28d847313e1e6c488"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:09:31.788615 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1178072060 Jul 25 23:09:31.788615 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Id: d37d3446345749b28d847313e1e6c488 Jul 25 23:09:31.788615 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1178072060 Jul 25 23:09:31.788615 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User: tempest-ServerRescueNegativeTestJSON-1178072060-project Jul 25 23:09:31.788615 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Id: default Jul 25 23:09:31.788615 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Name: Default Jul 25 23:09:31.788615 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Id: 61d3b5a3082a4c74a2a08007581388c0 Jul 25 23:09:31.788615 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1178072060-project Jul 25 23:09:31.788615 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: method: > Jul 25 23:09:31.788615 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: exception: Instance be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad could not be found. Jul 25 23:09:31.788615 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: action_args: {'id': 'be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad'} Jul 25 23:09:31.789535 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:09:31.789535 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:09:31.789535 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:09:31.789535 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:09:31.789535 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:09:31.789535 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:09:31.789535 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:09:31.789535 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:09:31.789535 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:09:31.789535 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:09:31.789535 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad could not be found. Jul 25 23:09:31.789535 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:09:31.789535 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:09:31.789535 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:09:31.789535 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:09:31.789535 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:09:31.789535 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:09:31.789535 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:09:31.789535 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:09:31.789535 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:09:31.790915 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:09:31.790915 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 23:09:31.790915 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 23:09:31.790915 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:09:31.790915 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:09:31.790915 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:09:31.790915 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:09:31.790915 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad could not be found. Jul 25 23:09:31.790915 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:09:31.790915 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:09:31.790915 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:09:31.790915 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:09:31.790915 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:09:31.790915 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:09:31.790915 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:09:31.790915 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:09:31.790915 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad could not be found. Jul 25 23:09:31.790915 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:09:31.792118 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-2f9fa34a-1e50-4a39-bf76-cb738580328d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Returning 404 to user: Instance be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad could not be found. {{(pid=118409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:09:31.792118 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-2f9fa34a-1e50-4a39-bf76-cb738580328d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad" status: 404 len: 111 microversion: 2.1 time: 0.030741 Jul 25 23:09:31.792118 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 342/691] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:31 2022] GET /compute/v2.1/servers/be96bb87-f1a3-4e0a-aa1d-61d6aa23e2ad => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:09:31.797324 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b6b348f2-1e3e-45de-97d2-6ae48c8bb2e1 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:31.797809 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b6b348f2-1e3e-45de-97d2-6ae48c8bb2e1 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:31.804652 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b6b348f2-1e3e-45de-97d2-6ae48c8bb2e1 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:31.805093 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b6b348f2-1e3e-45de-97d2-6ae48c8bb2e1 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:31.805927 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b6b348f2-1e3e-45de-97d2-6ae48c8bb2e1 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:31.806351 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b6b348f2-1e3e-45de-97d2-6ae48c8bb2e1 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:31.810487 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:09:31.835299 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b6b348f2-1e3e-45de-97d2-6ae48c8bb2e1 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Going to try to terminate instance {{(pid=118410) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 23:09:32.240900 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b6b348f2-1e3e-45de-97d2-6ae48c8bb2e1 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "DELETE /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 204 len: 0 microversion: 2.1 time: 0.446551 Jul 25 23:09:32.241734 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 350/692] 10.222.0.55 () {58 vars in 1239 bytes} [Mon Jul 25 23:09:31 2022] DELETE /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 23:09:32.249776 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-736fdfc2-6cad-444b-816e-98605cf6fc1f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:32.250388 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-736fdfc2-6cad-444b-816e-98605cf6fc1f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:32.257363 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-736fdfc2-6cad-444b-816e-98605cf6fc1f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:32.258108 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-736fdfc2-6cad-444b-816e-98605cf6fc1f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:32.259227 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-736fdfc2-6cad-444b-816e-98605cf6fc1f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:32.259771 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-736fdfc2-6cad-444b-816e-98605cf6fc1f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:32.410028 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-736fdfc2-6cad-444b-816e-98605cf6fc1f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:32.418133 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-736fdfc2-6cad-444b-816e-98605cf6fc1f tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1523 microversion: 2.1 time: 0.172059 Jul 25 23:09:32.418726 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 343/693] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:32 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:09:33.440434 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c3bdd50a-16f1-4c53-a478-a5c9db45a94d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:33.441153 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c3bdd50a-16f1-4c53-a478-a5c9db45a94d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:33.447973 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c3bdd50a-16f1-4c53-a478-a5c9db45a94d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:33.448422 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c3bdd50a-16f1-4c53-a478-a5c9db45a94d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:33.449225 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c3bdd50a-16f1-4c53-a478-a5c9db45a94d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:33.450049 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c3bdd50a-16f1-4c53-a478-a5c9db45a94d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:33.587654 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c3bdd50a-16f1-4c53-a478-a5c9db45a94d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:33.595175 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c3bdd50a-16f1-4c53-a478-a5c9db45a94d tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1523 microversion: 2.1 time: 0.159051 Jul 25 23:09:33.595737 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 351/694] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:33 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:09:34.616818 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-3cbd5b90-616d-4825-8b4b-d41ef345804b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:34.617478 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-3cbd5b90-616d-4825-8b4b-d41ef345804b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:34.619975 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:09:34.624734 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3cbd5b90-616d-4825-8b4b-d41ef345804b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:34.625205 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3cbd5b90-616d-4825-8b4b-d41ef345804b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:34.625961 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3cbd5b90-616d-4825-8b4b-d41ef345804b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:34.626417 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3cbd5b90-616d-4825-8b4b-d41ef345804b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:34.764391 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-3cbd5b90-616d-4825-8b4b-d41ef345804b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:34.772346 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-3cbd5b90-616d-4825-8b4b-d41ef345804b tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1523 microversion: 2.1 time: 0.159578 Jul 25 23:09:34.772905 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 344/695] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:34 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:09:35.794247 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-25136a34-564a-425a-8123-4368a2bb14b6 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:35.794874 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-25136a34-564a-425a-8123-4368a2bb14b6 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:35.797331 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:09:35.802347 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-25136a34-564a-425a-8123-4368a2bb14b6 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:35.806851 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-25136a34-564a-425a-8123-4368a2bb14b6 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:35.806851 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-25136a34-564a-425a-8123-4368a2bb14b6 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:35.806851 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-25136a34-564a-425a-8123-4368a2bb14b6 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:35.944886 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-25136a34-564a-425a-8123-4368a2bb14b6 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:35.952609 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-25136a34-564a-425a-8123-4368a2bb14b6 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1523 microversion: 2.1 time: 0.162214 Jul 25 23:09:35.953209 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 352/696] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:35 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:09:36.410112 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-13f4825b-21ef-4203-a523-fccee49a2064 req-543780c0-c8bb-4ddc-aedc-d8d9961a6434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f79f5efc-af32-4b3a-975a-aef5b386752f", "name": "network-vif-deleted", "tag": "adb509d8-1477-472c-bb38-e69e5cdd5c19"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:09:36.420195 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-13f4825b-21ef-4203-a523-fccee49a2064 req-543780c0-c8bb-4ddc-aedc-d8d9961a6434 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:36.420630 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-13f4825b-21ef-4203-a523-fccee49a2064 req-543780c0-c8bb-4ddc-aedc-d8d9961a6434 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:36.433108 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-13f4825b-21ef-4203-a523-fccee49a2064 req-543780c0-c8bb-4ddc-aedc-d8d9961a6434 service nova] Creating event network-vif-deleted:adb509d8-1477-472c-bb38-e69e5cdd5c19 for instance f79f5efc-af32-4b3a-975a-aef5b386752f on hv-cinder-79760 Jul 25 23:09:36.438103 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-13f4825b-21ef-4203-a523-fccee49a2064 req-543780c0-c8bb-4ddc-aedc-d8d9961a6434 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031627 Jul 25 23:09:36.438688 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 345/697] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:09:36.974666 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4decc1b9-ae3c-4d4c-8be0-d089afb4e063 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:36.975259 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4decc1b9-ae3c-4d4c-8be0-d089afb4e063 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:36.981856 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4decc1b9-ae3c-4d4c-8be0-d089afb4e063 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:36.991857 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4decc1b9-ae3c-4d4c-8be0-d089afb4e063 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:36.991857 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4decc1b9-ae3c-4d4c-8be0-d089afb4e063 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:36.991857 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4decc1b9-ae3c-4d4c-8be0-d089afb4e063 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:37.014678 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4decc1b9-ae3c-4d4c-8be0-d089afb4e063 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:37.015125 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4decc1b9-ae3c-4d4c-8be0-d089afb4e063 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:37.015572 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.objects.instance [None req-4decc1b9-ae3c-4d4c-8be0-d089afb4e063 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lazy-loading 'fault' on Instance uuid f79f5efc-af32-4b3a-975a-aef5b386752f {{(pid=118410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 23:09:37.058726 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4decc1b9-ae3c-4d4c-8be0-d089afb4e063 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61d3b5a3082a4c74a2a08007581388c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd37d3446345749b28d847313e1e6c488', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:37.066809 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4decc1b9-ae3c-4d4c-8be0-d089afb4e063 tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 200 len: 1312 microversion: 2.1 time: 0.096498 Jul 25 23:09:37.067311 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 353/698] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:36 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:09:38.093045 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-28ee4276-7b32-4508-ae74-f285e83615ec tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:38.093856 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-28ee4276-7b32-4508-ae74-f285e83615ec tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] [instance: f79f5efc-af32-4b3a-975a-aef5b386752f] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:38.099953 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-28ee4276-7b32-4508-ae74-f285e83615ec tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:38.100377 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-28ee4276-7b32-4508-ae74-f285e83615ec tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:38.101426 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-28ee4276-7b32-4508-ae74-f285e83615ec tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:38.101891 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-28ee4276-7b32-4508-ae74-f285e83615ec tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:38.115601 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.wsgi [None req-28ee4276-7b32-4508-ae74-f285e83615ec tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] HTTP exception thrown: Instance f79f5efc-af32-4b3a-975a-aef5b386752f could not be found. Jul 25 23:09:38.117148 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-28ee4276-7b32-4508-ae74-f285e83615ec tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Request method failure captured: Jul 25 23:09:38.117148 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: request: GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f HTTP/1.1 Jul 25 23:09:38.117148 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept: application/json Jul 25 23:09:38.117148 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept-Encoding: identity Jul 25 23:09:38.117148 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Connection: close Jul 25 23:09:38.117148 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Length: 0 Jul 25 23:09:38.117148 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Type: application/json Jul 25 23:09:38.117148 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Host: 10.222.0.55 Jul 25 23:09:38.117148 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Openstack-System-Scope: None Jul 25 23:09:38.117148 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: User-Agent: python-urllib3/1.26.10 Jul 25 23:09:38.117148 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Auth-Token: gAAAAABi3yFhkq942vbXnch_IaDKYkO2a3M4yfpDeC2Egpsw0NkwonPh9rBHysX1VIkRqYsB6WQirLUD5WvUZeDdUAXg7TkjmCnSiBSzeoce0TNVhD0leQwr5enAPBpaGFXzPzZMM9NzAOwUv2fBV_BWwBxc9go1JkJZo0Dfjd7PPELR0ji1dFs Jul 25 23:09:38.117148 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Id: None Jul 25 23:09:38.117148 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Name: None Jul 25 23:09:38.117148 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Identity-Status: Confirmed Jul 25 23:09:38.117148 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Is-Admin-Project: True Jul 25 23:09:38.117148 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Id: default Jul 25 23:09:38.117148 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Name: Default Jul 25 23:09:38.117148 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Id: d37d3446345749b28d847313e1e6c488 Jul 25 23:09:38.117148 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1178072060 Jul 25 23:09:38.117148 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Role: reader,member Jul 25 23:09:38.117148 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Roles: reader,member Jul 25 23:09:38.118788 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d37d3446345749b28d847313e1e6c488"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/d37d3446345749b28d847313e1e6c488"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_d37d3446345749b28d847313e1e6c488", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/d37d3446345749b28d847313e1e6c488"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:09:38.118788 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1178072060 Jul 25 23:09:38.118788 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Id: d37d3446345749b28d847313e1e6c488 Jul 25 23:09:38.118788 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1178072060 Jul 25 23:09:38.118788 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User: tempest-ServerRescueNegativeTestJSON-1178072060-project Jul 25 23:09:38.118788 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Id: default Jul 25 23:09:38.118788 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Name: Default Jul 25 23:09:38.118788 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Id: 61d3b5a3082a4c74a2a08007581388c0 Jul 25 23:09:38.118788 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1178072060-project Jul 25 23:09:38.118788 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: method: > Jul 25 23:09:38.118788 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: exception: Instance f79f5efc-af32-4b3a-975a-aef5b386752f could not be found. Jul 25 23:09:38.118788 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: action_args: {'id': 'f79f5efc-af32-4b3a-975a-aef5b386752f'} Jul 25 23:09:38.119910 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:09:38.119910 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:09:38.119910 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:09:38.119910 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:09:38.119910 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:09:38.119910 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:09:38.119910 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:09:38.119910 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:09:38.119910 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:09:38.119910 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:09:38.119910 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f79f5efc-af32-4b3a-975a-aef5b386752f could not be found. Jul 25 23:09:38.119910 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:09:38.119910 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:09:38.119910 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:09:38.119910 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:09:38.119910 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:09:38.119910 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:09:38.119910 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:09:38.119910 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:09:38.119910 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:09:38.121432 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:09:38.121432 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 23:09:38.121432 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 23:09:38.121432 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:09:38.121432 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:09:38.121432 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:09:38.121432 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:09:38.121432 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f79f5efc-af32-4b3a-975a-aef5b386752f could not be found. Jul 25 23:09:38.121432 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:09:38.121432 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:09:38.121432 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:09:38.121432 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:09:38.121432 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:09:38.121432 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:09:38.121432 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:09:38.121432 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:09:38.121432 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f79f5efc-af32-4b3a-975a-aef5b386752f could not be found. Jul 25 23:09:38.121432 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:09:38.123063 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-28ee4276-7b32-4508-ae74-f285e83615ec tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] Returning 404 to user: Instance f79f5efc-af32-4b3a-975a-aef5b386752f could not be found. {{(pid=118409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:09:38.123063 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-28ee4276-7b32-4508-ae74-f285e83615ec tempest-ServerRescueNegativeTestJSON-1178072060 tempest-ServerRescueNegativeTestJSON-1178072060-project] 10.222.0.55 "GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f" status: 404 len: 111 microversion: 2.1 time: 0.030472 Jul 25 23:09:38.123063 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 346/699] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:09:38 2022] GET /compute/v2.1/servers/f79f5efc-af32-4b3a-975a-aef5b386752f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 23:09:42.859076 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-cb2ada3e-0534-4ebc-b0fb-51011160a5a5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:42.860183 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-cb2ada3e-0534-4ebc-b0fb-51011160a5a5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:42.866700 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cb2ada3e-0534-4ebc-b0fb-51011160a5a5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:42.867372 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cb2ada3e-0534-4ebc-b0fb-51011160a5a5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:42.868345 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cb2ada3e-0534-4ebc-b0fb-51011160a5a5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:42.868702 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cb2ada3e-0534-4ebc-b0fb-51011160a5a5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:42.893334 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-cb2ada3e-0534-4ebc-b0fb-51011160a5a5 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954/ips" status: 200 len: 151 microversion: 2.20 time: 0.275009 Jul 25 23:09:42.893902 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 354/700] 10.222.0.55 () {60 vars in 1289 bytes} [Mon Jul 25 23:09:42 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954/ips => generated 151 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 25 23:09:43.881234 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-725d374f-244f-4544-99fd-d160c77cee7f tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] Action: 'create', calling method: .version_select at 0x7f6226de33a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-985265362"}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:09:44.613667 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-725d374f-244f-4544-99fd-d160c77cee7f tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] 10.222.0.55 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.848269 Jul 25 23:09:44.614279 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 347/701] 10.222.0.55 () {60 vars in 1155 bytes} [Mon Jul 25 23:09:43 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 850 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 25 23:09:44.626995 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-99f5aa8b-34d8-4aa2-af9a-bfd9471aba8e tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] Calling method '.version_select at 0x7f6226e543a0>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:44.680521 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-99f5aa8b-34d8-4aa2-af9a-bfd9471aba8e tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/045e9cf6-8980-4e34-a15c-dce7dcd7a806" status: 200 len: 344 microversion: 2.1 time: 0.057325 Jul 25 23:09:44.681227 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 355/702] 10.222.0.55 () {58 vars in 1245 bytes} [Mon Jul 25 23:09:44 2022] GET /compute/v2.1/os-volumes/045e9cf6-8980-4e34-a15c-dce7dcd7a806 => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:09:45.290020 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-e653d894-88c8-4cc4-a439-bb6a04ca458c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:09:45.290580 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-e653d894-88c8-4cc4-a439-bb6a04ca458c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:45.297579 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e653d894-88c8-4cc4-a439-bb6a04ca458c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:45.298028 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e653d894-88c8-4cc4-a439-bb6a04ca458c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:45.298799 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e653d894-88c8-4cc4-a439-bb6a04ca458c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:45.299229 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e653d894-88c8-4cc4-a439-bb6a04ca458c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:45.323850 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.objects.instance [None req-e653d894-88c8-4cc4-a439-bb6a04ca458c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lazy-loading 'flavor' on Instance uuid c5f69472-1864-4211-b288-44e579367954 {{(pid=118409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 23:09:45.696470 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-66e58f8b-1198-45dc-9549-747e91b9f7ce tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] Calling method '.version_select at 0x7f6226cfa280>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:45.746528 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-66e58f8b-1198-45dc-9549-747e91b9f7ce tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/045e9cf6-8980-4e34-a15c-dce7dcd7a806" status: 200 len: 345 microversion: 2.1 time: 0.055802 Jul 25 23:09:45.754649 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 356/703] 10.222.0.55 () {58 vars in 1245 bytes} [Mon Jul 25 23:09:45 2022] GET /compute/v2.1/os-volumes/045e9cf6-8980-4e34-a15c-dce7dcd7a806 => generated 345 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 23:09:45.760141 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-ebb703ba-848e-4218-a464-408a647d4cc3 tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] Action: 'create', calling method: .version_select at 0x7f6226cc01f0>, body: {"snapshot": {"volume_id": "045e9cf6-8980-4e34-a15c-dce7dcd7a806", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-233866346"}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:09:45.799055 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-e653d894-88c8-4cc4-a439-bb6a04ca458c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "POST /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954/action" status: 202 len: 0 microversion: 2.20 time: 0.513733 Jul 25 23:09:45.799784 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 348/704] 10.222.0.55 () {62 vars in 1319 bytes} [Mon Jul 25 23:09:45 2022] POST /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954/action => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 23:09:45.809220 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-d3b6c827-8ddf-46e2-8ef9-45194e1201e3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:45.810840 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-d3b6c827-8ddf-46e2-8ef9-45194e1201e3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:45.818093 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d3b6c827-8ddf-46e2-8ef9-45194e1201e3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:45.819020 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d3b6c827-8ddf-46e2-8ef9-45194e1201e3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:45.820526 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d3b6c827-8ddf-46e2-8ef9-45194e1201e3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:45.821153 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d3b6c827-8ddf-46e2-8ef9-45194e1201e3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:45.970049 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-d3b6c827-8ddf-46e2-8ef9-45194e1201e3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:45.979517 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-d3b6c827-8ddf-46e2-8ef9-45194e1201e3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:45.981101 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-d3b6c827-8ddf-46e2-8ef9-45194e1201e3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:45.982333 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-d3b6c827-8ddf-46e2-8ef9-45194e1201e3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1723 microversion: 2.20 time: 0.177611 Jul 25 23:09:45.992743 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 349/705] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:09:45 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:09:46.269490 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-ebb703ba-848e-4218-a464-408a647d4cc3 tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] 10.222.0.55 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.513564 Jul 25 23:09:46.270199 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 357/706] 10.222.0.55 () {60 vars in 1162 bytes} [Mon Jul 25 23:09:45 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:09:46.284245 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-c6416e69-3240-4eba-935b-1a6faa4d805b tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] Calling method '.version_select at 0x7f622f802040>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:46.314236 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-c6416e69-3240-4eba-935b-1a6faa4d805b tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/fbd5ff84-58b3-4906-8f07-74c93a367042" status: 200 len: 286 microversion: 2.1 time: 0.036276 Jul 25 23:09:46.315110 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 350/707] 10.222.0.55 () {58 vars in 1251 bytes} [Mon Jul 25 23:09:46 2022] GET /compute/v2.1/os-snapshots/fbd5ff84-58b3-4906-8f07-74c93a367042 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:09:46.325622 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0c5a2771-5e03-4c93-9eee-8405a916e907 tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] Calling method '.version_select at 0x7f6226d30b80>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:46.358156 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-0c5a2771-5e03-4c93-9eee-8405a916e907 tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.036232 Jul 25 23:09:46.358765 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 358/708] 10.222.0.55 () {58 vars in 1140 bytes} [Mon Jul 25 23:09:46 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:09:46.370459 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-8b6168f7-c35d-4696-8821-5177e7690f12 tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] Calling method '.version_select at 0x7f6226e06ee0>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:46.401108 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-8b6168f7-c35d-4696-8821-5177e7690f12 tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/fbd5ff84-58b3-4906-8f07-74c93a367042" status: 200 len: 286 microversion: 2.1 time: 0.034907 Jul 25 23:09:46.401706 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 351/709] 10.222.0.55 () {58 vars in 1251 bytes} [Mon Jul 25 23:09:46 2022] GET /compute/v2.1/os-snapshots/fbd5ff84-58b3-4906-8f07-74c93a367042 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:09:47.006622 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f8fd83f1-f7e3-404c-9028-3bff77968ba2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:47.007843 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f8fd83f1-f7e3-404c-9028-3bff77968ba2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:47.014620 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f8fd83f1-f7e3-404c-9028-3bff77968ba2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:47.015046 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f8fd83f1-f7e3-404c-9028-3bff77968ba2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:47.015796 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f8fd83f1-f7e3-404c-9028-3bff77968ba2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:47.016220 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f8fd83f1-f7e3-404c-9028-3bff77968ba2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:47.145962 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f8fd83f1-f7e3-404c-9028-3bff77968ba2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:47.154497 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f8fd83f1-f7e3-404c-9028-3bff77968ba2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:47.155976 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f8fd83f1-f7e3-404c-9028-3bff77968ba2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:47.157146 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f8fd83f1-f7e3-404c-9028-3bff77968ba2 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1723 microversion: 2.20 time: 0.155087 Jul 25 23:09:47.157693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 359/710] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:09:47 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:09:47.413999 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-f414fb96-9d31-46d6-9104-88e06567a51b tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] Calling method '.version_select at 0x7f622f7bb1f0>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:47.444379 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-f414fb96-9d31-46d6-9104-88e06567a51b tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/fbd5ff84-58b3-4906-8f07-74c93a367042" status: 200 len: 286 microversion: 2.1 time: 0.034860 Jul 25 23:09:47.444936 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 352/711] 10.222.0.55 () {58 vars in 1251 bytes} [Mon Jul 25 23:09:47 2022] GET /compute/v2.1/os-snapshots/fbd5ff84-58b3-4906-8f07-74c93a367042 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:09:48.180467 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-1acdd4d0-5cba-4335-a492-f8c9bec47e87 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:48.180985 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-1acdd4d0-5cba-4335-a492-f8c9bec47e87 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:48.187527 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1acdd4d0-5cba-4335-a492-f8c9bec47e87 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:48.187969 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1acdd4d0-5cba-4335-a492-f8c9bec47e87 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:48.188727 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1acdd4d0-5cba-4335-a492-f8c9bec47e87 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:48.189179 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1acdd4d0-5cba-4335-a492-f8c9bec47e87 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:48.320055 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-1acdd4d0-5cba-4335-a492-f8c9bec47e87 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:48.329286 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-1acdd4d0-5cba-4335-a492-f8c9bec47e87 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:48.330793 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-1acdd4d0-5cba-4335-a492-f8c9bec47e87 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:48.331952 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-1acdd4d0-5cba-4335-a492-f8c9bec47e87 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1723 microversion: 2.20 time: 0.155526 Jul 25 23:09:48.332518 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 360/712] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:09:48 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:09:48.457351 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-0c20c54e-f4a1-4b76-b9f6-2fd4c49e89b8 tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] Calling method '.version_select at 0x7f622f802ee0>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:48.486621 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-0c20c54e-f4a1-4b76-b9f6-2fd4c49e89b8 tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/fbd5ff84-58b3-4906-8f07-74c93a367042" status: 200 len: 286 microversion: 2.1 time: 0.033844 Jul 25 23:09:48.487195 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 353/713] 10.222.0.55 () {58 vars in 1251 bytes} [Mon Jul 25 23:09:48 2022] GET /compute/v2.1/os-snapshots/fbd5ff84-58b3-4906-8f07-74c93a367042 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:09:49.356431 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-931f81df-3d81-4306-b165-1f0d23174266 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:49.357243 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-931f81df-3d81-4306-b165-1f0d23174266 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:49.363961 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-931f81df-3d81-4306-b165-1f0d23174266 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:49.364404 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-931f81df-3d81-4306-b165-1f0d23174266 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:49.365348 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-931f81df-3d81-4306-b165-1f0d23174266 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:49.365782 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-931f81df-3d81-4306-b165-1f0d23174266 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:49.496725 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-931f81df-3d81-4306-b165-1f0d23174266 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:49.499804 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-e484d729-8673-4d21-b621-d891a6778f6d tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] Calling method '.version_select at 0x7f6226e4da60>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:49.504691 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-931f81df-3d81-4306-b165-1f0d23174266 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:49.506247 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-931f81df-3d81-4306-b165-1f0d23174266 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:49.507397 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-931f81df-3d81-4306-b165-1f0d23174266 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1723 microversion: 2.20 time: 0.155860 Jul 25 23:09:49.508495 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 361/714] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:09:49 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:09:49.531111 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-e484d729-8673-4d21-b621-d891a6778f6d tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/fbd5ff84-58b3-4906-8f07-74c93a367042" status: 200 len: 287 microversion: 2.1 time: 0.035757 Jul 25 23:09:49.531708 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 354/715] 10.222.0.55 () {58 vars in 1251 bytes} [Mon Jul 25 23:09:49 2022] GET /compute/v2.1/os-snapshots/fbd5ff84-58b3-4906-8f07-74c93a367042 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:09:49.542758 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-428b4882-7e3d-4ca8-abba-85dfb5f49d0c tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] Calling method '.version_select at 0x7f6226cfae50>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:49.656480 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-428b4882-7e3d-4ca8-abba-85dfb5f49d0c tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] 10.222.0.55 "DELETE /compute/v2.1/os-snapshots/fbd5ff84-58b3-4906-8f07-74c93a367042" status: 202 len: 0 microversion: 2.1 time: 0.117490 Jul 25 23:09:49.657038 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 362/716] 10.222.0.55 () {58 vars in 1254 bytes} [Mon Jul 25 23:09:49 2022] DELETE /compute/v2.1/os-snapshots/fbd5ff84-58b3-4906-8f07-74c93a367042 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 23:09:49.665429 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-0446b524-3e99-4de9-901f-ea9c55928ce9 tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] Calling method '.version_select at 0x7f622f801550>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:49.696050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-0446b524-3e99-4de9-901f-ea9c55928ce9 tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/fbd5ff84-58b3-4906-8f07-74c93a367042" status: 200 len: 286 microversion: 2.1 time: 0.033792 Jul 25 23:09:49.696692 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 355/717] 10.222.0.55 () {58 vars in 1251 bytes} [Mon Jul 25 23:09:49 2022] GET /compute/v2.1/os-snapshots/fbd5ff84-58b3-4906-8f07-74c93a367042 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:09:50.531963 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-eefa23c5-a497-4213-842f-8f34f0d8d71d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:50.532594 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-eefa23c5-a497-4213-842f-8f34f0d8d71d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:50.538786 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-eefa23c5-a497-4213-842f-8f34f0d8d71d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:50.539322 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-eefa23c5-a497-4213-842f-8f34f0d8d71d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:50.540183 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-eefa23c5-a497-4213-842f-8f34f0d8d71d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:50.540615 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-eefa23c5-a497-4213-842f-8f34f0d8d71d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:50.670643 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-eefa23c5-a497-4213-842f-8f34f0d8d71d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:50.678514 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-eefa23c5-a497-4213-842f-8f34f0d8d71d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:50.680477 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-eefa23c5-a497-4213-842f-8f34f0d8d71d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:50.681820 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-eefa23c5-a497-4213-842f-8f34f0d8d71d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1723 microversion: 2.20 time: 0.154330 Jul 25 23:09:50.682382 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 363/718] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:09:50 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:09:50.708313 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-5e128b4f-de1f-4d21-ba61-ab5abae2c5d9 tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] Calling method '.version_select at 0x7f6226e4daf0>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:50.733063 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.wsgi [None req-5e128b4f-de1f-4d21-ba61-ab5abae2c5d9 tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] HTTP exception thrown: Snapshot fbd5ff84-58b3-4906-8f07-74c93a367042 could not be found. Jul 25 23:09:50.735500 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-5e128b4f-de1f-4d21-ba61-ab5abae2c5d9 tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] Request method failure captured: Jul 25 23:09:50.735500 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: request: GET /compute/v2.1/os-snapshots/fbd5ff84-58b3-4906-8f07-74c93a367042 HTTP/1.1 Jul 25 23:09:50.735500 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept: application/json Jul 25 23:09:50.735500 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept-Encoding: identity Jul 25 23:09:50.735500 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Connection: close Jul 25 23:09:50.735500 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Length: 0 Jul 25 23:09:50.735500 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Type: application/json Jul 25 23:09:50.735500 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Host: 10.222.0.55 Jul 25 23:09:50.735500 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Openstack-System-Scope: None Jul 25 23:09:50.735500 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: User-Agent: python-urllib3/1.26.10 Jul 25 23:09:50.735500 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Auth-Token: gAAAAABi3yK36s7pjcxAmIrVBIAv2RO21_LOcraZJ92mwOBqgdIjUTYLUPBJkcR1EreM6QKj-ZSfhNLp-Qsu_7inzeNDQ6wVW65WZZkm7W9BtwTTsYNljrznjeASCTLEv3Ld91B26PSeVqVklr9l5BgsUW6yxpl0WBoqVvI8xjRmDYNRH1V4CnI Jul 25 23:09:50.735500 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Id: None Jul 25 23:09:50.735500 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Name: None Jul 25 23:09:50.735500 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Identity-Status: Confirmed Jul 25 23:09:50.735500 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Is-Admin-Project: True Jul 25 23:09:50.735500 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Id: default Jul 25 23:09:50.735500 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Name: Default Jul 25 23:09:50.735500 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Id: 2c8cb9af06ab4ab8aad85ded41095126 Jul 25 23:09:50.735500 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-558262901 Jul 25 23:09:50.735500 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Role: reader,member Jul 25 23:09:50.735500 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Roles: reader,member Jul 25 23:09:50.736971 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2c8cb9af06ab4ab8aad85ded41095126"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2c8cb9af06ab4ab8aad85ded41095126"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_2c8cb9af06ab4ab8aad85ded41095126", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/2c8cb9af06ab4ab8aad85ded41095126"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:09:50.736971 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant: tempest-VolumesSnapshotsTestJSON-558262901 Jul 25 23:09:50.736971 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Id: 2c8cb9af06ab4ab8aad85ded41095126 Jul 25 23:09:50.736971 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-558262901 Jul 25 23:09:50.736971 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User: tempest-VolumesSnapshotsTestJSON-558262901-project Jul 25 23:09:50.736971 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Id: default Jul 25 23:09:50.736971 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Name: Default Jul 25 23:09:50.736971 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Id: 244806b9aaf24471a8cad381c1b71dfe Jul 25 23:09:50.736971 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Name: tempest-VolumesSnapshotsTestJSON-558262901-project Jul 25 23:09:50.736971 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: method: Jul 25 23:09:50.736971 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: exception: Snapshot fbd5ff84-58b3-4906-8f07-74c93a367042 could not be found. Jul 25 23:09:50.736971 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: action_args: {'id': 'fbd5ff84-58b3-4906-8f07-74c93a367042'} Jul 25 23:09:50.736971 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:09:50.738024 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:09:50.738024 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 25 23:09:50.738024 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 25 23:09:50.738024 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 25 23:09:50.738024 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 25 23:09:50.738024 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 25 23:09:50.738024 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 25 23:09:50.738024 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 23:09:50.738024 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 23:09:50.738024 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 23:09:50.738024 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 23:09:50.738024 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 23:09:50.738024 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 23:09:50.738024 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 23:09:50.738024 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 23:09:50.738024 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot fbd5ff84-58b3-4906-8f07-74c93a367042 could not be found. (HTTP 404) (Request-ID: req-8102c394-d657-41f5-ac20-66543515c278) Jul 25 23:09:50.738024 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:09:50.738024 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:09:50.739066 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:09:50.739066 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:09:50.739066 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 25 23:09:50.739066 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 25 23:09:50.739066 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 23:09:50.739066 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 23:09:50.739066 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 25 23:09:50.739066 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 25 23:09:50.739066 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 23:09:50.739066 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 23:09:50.739066 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 25 23:09:50.739066 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 25 23:09:50.739066 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 25 23:09:50.739066 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 25 23:09:50.739066 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 25 23:09:50.739066 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 25 23:09:50.739066 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 23:09:50.739066 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 23:09:50.739066 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 23:09:50.740153 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 23:09:50.740153 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 23:09:50.740153 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 23:09:50.740153 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 23:09:50.740153 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 23:09:50.740153 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot fbd5ff84-58b3-4906-8f07-74c93a367042 could not be found. Jul 25 23:09:50.740153 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:09:50.740153 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:09:50.740153 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:09:50.740153 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:09:50.740153 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:09:50.740153 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:09:50.740153 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:09:50.740153 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:09:50.740153 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 23:09:50.740153 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 23:09:50.740153 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:09:50.740153 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:09:50.740153 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 25 23:09:50.740153 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:09:50.748122 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot fbd5ff84-58b3-4906-8f07-74c93a367042 could not be found. Jul 25 23:09:50.748122 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:09:50.748122 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:09:50.748122 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:09:50.748122 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:09:50.748122 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:09:50.748122 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:09:50.748122 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:09:50.748122 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:09:50.748122 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot fbd5ff84-58b3-4906-8f07-74c93a367042 could not be found. Jul 25 23:09:50.748122 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:09:50.748122 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-5e128b4f-de1f-4d21-ba61-ab5abae2c5d9 tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] Returning 404 to user: Snapshot fbd5ff84-58b3-4906-8f07-74c93a367042 could not be found. {{(pid=118409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:09:50.748122 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-5e128b4f-de1f-4d21-ba61-ab5abae2c5d9 tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] 10.222.0.55 "GET /compute/v2.1/os-snapshots/fbd5ff84-58b3-4906-8f07-74c93a367042" status: 404 len: 111 microversion: 2.1 time: 0.033092 Jul 25 23:09:50.748122 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 356/719] 10.222.0.55 () {58 vars in 1251 bytes} [Mon Jul 25 23:09:50 2022] GET /compute/v2.1/os-snapshots/fbd5ff84-58b3-4906-8f07-74c93a367042 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:09:50.749189 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-502a0f2c-7e62-44ca-9c55-009a646cca5a tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] Calling method '.version_select at 0x7f6226cfaf70>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:50.931064 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-502a0f2c-7e62-44ca-9c55-009a646cca5a tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/045e9cf6-8980-4e34-a15c-dce7dcd7a806" status: 202 len: 0 microversion: 2.1 time: 0.189049 Jul 25 23:09:50.931633 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 364/720] 10.222.0.55 () {58 vars in 1248 bytes} [Mon Jul 25 23:09:50 2022] DELETE /compute/v2.1/os-volumes/045e9cf6-8980-4e34-a15c-dce7dcd7a806 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 23:09:50.939884 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-7d05e5c0-35b8-4070-a40c-497cc62da38e tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] Calling method '.version_select at 0x7f622f813f70>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:50.987678 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-7d05e5c0-35b8-4070-a40c-497cc62da38e tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/045e9cf6-8980-4e34-a15c-dce7dcd7a806" status: 200 len: 344 microversion: 2.1 time: 0.051600 Jul 25 23:09:50.988278 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 357/721] 10.222.0.55 () {58 vars in 1245 bytes} [Mon Jul 25 23:09:50 2022] GET /compute/v2.1/os-volumes/045e9cf6-8980-4e34-a15c-dce7dcd7a806 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:09:51.706163 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-7adce27d-a015-4340-a53c-3370f0bf0bf8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:51.706767 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-7adce27d-a015-4340-a53c-3370f0bf0bf8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:51.713025 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7adce27d-a015-4340-a53c-3370f0bf0bf8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:51.713504 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7adce27d-a015-4340-a53c-3370f0bf0bf8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:51.714270 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7adce27d-a015-4340-a53c-3370f0bf0bf8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:51.714701 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7adce27d-a015-4340-a53c-3370f0bf0bf8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:51.847268 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7adce27d-a015-4340-a53c-3370f0bf0bf8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:51.855977 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7adce27d-a015-4340-a53c-3370f0bf0bf8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:51.857602 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7adce27d-a015-4340-a53c-3370f0bf0bf8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:51.858746 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-7adce27d-a015-4340-a53c-3370f0bf0bf8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1723 microversion: 2.20 time: 0.157113 Jul 25 23:09:51.859303 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 365/722] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:09:51 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:09:52.003173 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-69c1dbed-44e4-4f84-b142-e24832c70ac0 tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] Calling method '.version_select at 0x7f622f801b80>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:52.030768 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.wsgi [None req-69c1dbed-44e4-4f84-b142-e24832c70ac0 tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] HTTP exception thrown: Volume 045e9cf6-8980-4e34-a15c-dce7dcd7a806 could not be found. Jul 25 23:09:52.032735 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-69c1dbed-44e4-4f84-b142-e24832c70ac0 tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] Request method failure captured: Jul 25 23:09:52.032735 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: request: GET /compute/v2.1/os-volumes/045e9cf6-8980-4e34-a15c-dce7dcd7a806 HTTP/1.1 Jul 25 23:09:52.032735 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept: application/json Jul 25 23:09:52.032735 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept-Encoding: identity Jul 25 23:09:52.032735 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Connection: close Jul 25 23:09:52.032735 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Length: 0 Jul 25 23:09:52.032735 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Type: application/json Jul 25 23:09:52.032735 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Host: 10.222.0.55 Jul 25 23:09:52.032735 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Openstack-System-Scope: None Jul 25 23:09:52.032735 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: User-Agent: python-urllib3/1.26.10 Jul 25 23:09:52.032735 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Auth-Token: gAAAAABi3yK36s7pjcxAmIrVBIAv2RO21_LOcraZJ92mwOBqgdIjUTYLUPBJkcR1EreM6QKj-ZSfhNLp-Qsu_7inzeNDQ6wVW65WZZkm7W9BtwTTsYNljrznjeASCTLEv3Ld91B26PSeVqVklr9l5BgsUW6yxpl0WBoqVvI8xjRmDYNRH1V4CnI Jul 25 23:09:52.032735 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Id: None Jul 25 23:09:52.032735 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Name: None Jul 25 23:09:52.032735 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Identity-Status: Confirmed Jul 25 23:09:52.032735 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Is-Admin-Project: True Jul 25 23:09:52.032735 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Id: default Jul 25 23:09:52.032735 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Name: Default Jul 25 23:09:52.032735 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Id: 2c8cb9af06ab4ab8aad85ded41095126 Jul 25 23:09:52.032735 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-558262901 Jul 25 23:09:52.032735 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Role: reader,member Jul 25 23:09:52.032735 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Roles: reader,member Jul 25 23:09:52.035145 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2c8cb9af06ab4ab8aad85ded41095126"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2c8cb9af06ab4ab8aad85ded41095126"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_2c8cb9af06ab4ab8aad85ded41095126", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/2c8cb9af06ab4ab8aad85ded41095126"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:09:52.035145 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant: tempest-VolumesSnapshotsTestJSON-558262901 Jul 25 23:09:52.035145 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Id: 2c8cb9af06ab4ab8aad85ded41095126 Jul 25 23:09:52.035145 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-558262901 Jul 25 23:09:52.035145 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User: tempest-VolumesSnapshotsTestJSON-558262901-project Jul 25 23:09:52.035145 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Id: default Jul 25 23:09:52.035145 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Name: Default Jul 25 23:09:52.035145 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Id: 244806b9aaf24471a8cad381c1b71dfe Jul 25 23:09:52.035145 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Name: tempest-VolumesSnapshotsTestJSON-558262901-project Jul 25 23:09:52.035145 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: method: Jul 25 23:09:52.035145 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: exception: Volume 045e9cf6-8980-4e34-a15c-dce7dcd7a806 could not be found. Jul 25 23:09:52.035145 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: action_args: {'id': '045e9cf6-8980-4e34-a15c-dce7dcd7a806'} Jul 25 23:09:52.035145 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:09:52.036116 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:09:52.036116 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 23:09:52.036116 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 23:09:52.036116 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 23:09:52.036116 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 23:09:52.036116 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 23:09:52.036116 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 23:09:52.036116 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 23:09:52.036116 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 23:09:52.036116 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 23:09:52.036116 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 23:09:52.036116 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 23:09:52.036116 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 23:09:52.036116 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 23:09:52.036116 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 23:09:52.036116 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 045e9cf6-8980-4e34-a15c-dce7dcd7a806 could not be found. (HTTP 404) (Request-ID: req-4eff0fc8-b147-40ad-9fb5-360dba5287b1) Jul 25 23:09:52.036116 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:09:52.036116 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:09:52.036116 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:09:52.037673 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:09:52.037673 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 23:09:52.037673 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 23:09:52.037673 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 23:09:52.037673 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 23:09:52.037673 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 23:09:52.037673 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 23:09:52.037673 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 23:09:52.037673 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 23:09:52.037673 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 23:09:52.037673 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 23:09:52.037673 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 23:09:52.037673 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 23:09:52.037673 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 23:09:52.037673 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 23:09:52.037673 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 23:09:52.037673 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 23:09:52.037673 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 23:09:52.037673 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 23:09:52.041084 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 23:09:52.041084 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 23:09:52.041084 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 23:09:52.041084 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 23:09:52.041084 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 045e9cf6-8980-4e34-a15c-dce7dcd7a806 could not be found. Jul 25 23:09:52.041084 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:09:52.041084 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:09:52.041084 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:09:52.041084 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:09:52.041084 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:09:52.041084 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:09:52.041084 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:09:52.041084 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:09:52.041084 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 23:09:52.041084 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 23:09:52.041084 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:09:52.041084 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:09:52.041084 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 23:09:52.041084 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:09:52.042610 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 045e9cf6-8980-4e34-a15c-dce7dcd7a806 could not be found. Jul 25 23:09:52.042610 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:09:52.042610 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:09:52.042610 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:09:52.042610 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:09:52.042610 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:09:52.042610 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:09:52.042610 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:09:52.042610 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:09:52.042610 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 045e9cf6-8980-4e34-a15c-dce7dcd7a806 could not be found. Jul 25 23:09:52.042610 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:09:52.042610 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-69c1dbed-44e4-4f84-b142-e24832c70ac0 tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] Returning 404 to user: Volume 045e9cf6-8980-4e34-a15c-dce7dcd7a806 could not be found. {{(pid=118409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:09:52.042610 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-69c1dbed-44e4-4f84-b142-e24832c70ac0 tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/045e9cf6-8980-4e34-a15c-dce7dcd7a806" status: 404 len: 109 microversion: 2.1 time: 0.035496 Jul 25 23:09:52.042610 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 358/723] 10.222.0.55 () {58 vars in 1245 bytes} [Mon Jul 25 23:09:51 2022] GET /compute/v2.1/os-volumes/045e9cf6-8980-4e34-a15c-dce7dcd7a806 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:09:52.050400 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-8fa9aa2e-1000-4782-9a66-5082b2f7a733 tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] Calling method '.version_select at 0x7f6226cfa9d0>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:52.078579 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-8fa9aa2e-1000-4782-9a66-5082b2f7a733 tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] HTTP exception thrown: Volume 045e9cf6-8980-4e34-a15c-dce7dcd7a806 could not be found. Jul 25 23:09:52.080412 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-8fa9aa2e-1000-4782-9a66-5082b2f7a733 tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] Request method failure captured: Jul 25 23:09:52.080412 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: request: DELETE /compute/v2.1/os-volumes/045e9cf6-8980-4e34-a15c-dce7dcd7a806 HTTP/1.1 Jul 25 23:09:52.080412 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 25 23:09:52.080412 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 25 23:09:52.080412 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Connection: close Jul 25 23:09:52.080412 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 25 23:09:52.080412 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 25 23:09:52.080412 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Host: 10.222.0.55 Jul 25 23:09:52.080412 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 25 23:09:52.080412 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.10 Jul 25 23:09:52.080412 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABi3yK36s7pjcxAmIrVBIAv2RO21_LOcraZJ92mwOBqgdIjUTYLUPBJkcR1EreM6QKj-ZSfhNLp-Qsu_7inzeNDQ6wVW65WZZkm7W9BtwTTsYNljrznjeASCTLEv3Ld91B26PSeVqVklr9l5BgsUW6yxpl0WBoqVvI8xjRmDYNRH1V4CnI Jul 25 23:09:52.080412 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 25 23:09:52.080412 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 25 23:09:52.080412 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 25 23:09:52.080412 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 25 23:09:52.080412 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 25 23:09:52.080412 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 25 23:09:52.080412 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Id: 2c8cb9af06ab4ab8aad85ded41095126 Jul 25 23:09:52.080412 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-558262901 Jul 25 23:09:52.080412 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Role: reader,member Jul 25 23:09:52.080412 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Roles: reader,member Jul 25 23:09:52.081909 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2c8cb9af06ab4ab8aad85ded41095126"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2c8cb9af06ab4ab8aad85ded41095126"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_2c8cb9af06ab4ab8aad85ded41095126", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/2c8cb9af06ab4ab8aad85ded41095126"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:09:52.081909 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-VolumesSnapshotsTestJSON-558262901 Jul 25 23:09:52.081909 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Id: 2c8cb9af06ab4ab8aad85ded41095126 Jul 25 23:09:52.081909 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-558262901 Jul 25 23:09:52.081909 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User: tempest-VolumesSnapshotsTestJSON-558262901-project Jul 25 23:09:52.081909 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 25 23:09:52.081909 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 25 23:09:52.081909 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Id: 244806b9aaf24471a8cad381c1b71dfe Jul 25 23:09:52.081909 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-VolumesSnapshotsTestJSON-558262901-project Jul 25 23:09:52.081909 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: method: Jul 25 23:09:52.081909 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: exception: Volume 045e9cf6-8980-4e34-a15c-dce7dcd7a806 could not be found. Jul 25 23:09:52.081909 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: action_args: {'id': '045e9cf6-8980-4e34-a15c-dce7dcd7a806'} Jul 25 23:09:52.081909 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:09:52.082911 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:09:52.082911 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 23:09:52.082911 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 23:09:52.082911 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 23:09:52.082911 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 23:09:52.082911 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 23:09:52.082911 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 23:09:52.082911 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 23:09:52.082911 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 23:09:52.082911 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 23:09:52.082911 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 23:09:52.082911 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 23:09:52.082911 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 23:09:52.082911 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 23:09:52.082911 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 23:09:52.082911 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 045e9cf6-8980-4e34-a15c-dce7dcd7a806 could not be found. (HTTP 404) (Request-ID: req-0b9e021d-56b2-4cc6-8f04-12687d965d5f) Jul 25 23:09:52.082911 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:09:52.082911 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:09:52.082911 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:09:52.084182 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:09:52.084182 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 25 23:09:52.084182 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 25 23:09:52.084182 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 23:09:52.084182 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 23:09:52.084182 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 23:09:52.084182 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 23:09:52.084182 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 23:09:52.084182 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 23:09:52.084182 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 23:09:52.084182 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 23:09:52.084182 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 25 23:09:52.084182 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 25 23:09:52.084182 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 25 23:09:52.084182 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 25 23:09:52.084182 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 25 23:09:52.084182 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 25 23:09:52.084182 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 25 23:09:52.084182 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 25 23:09:52.085400 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 23:09:52.085400 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 23:09:52.085400 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 23:09:52.085400 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 23:09:52.085400 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 045e9cf6-8980-4e34-a15c-dce7dcd7a806 could not be found. Jul 25 23:09:52.085400 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:09:52.085400 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:09:52.085400 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:09:52.085400 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:09:52.085400 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:09:52.085400 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:09:52.085400 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:09:52.085400 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:09:52.085400 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 23:09:52.085400 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 23:09:52.085400 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:09:52.085400 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:09:52.085400 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 25 23:09:52.085400 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:09:52.087567 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 045e9cf6-8980-4e34-a15c-dce7dcd7a806 could not be found. Jul 25 23:09:52.087567 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:09:52.087567 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:09:52.087567 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:09:52.087567 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:09:52.087567 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:09:52.087567 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:09:52.087567 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:09:52.087567 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:09:52.087567 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 045e9cf6-8980-4e34-a15c-dce7dcd7a806 could not be found. Jul 25 23:09:52.087567 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:09:52.087567 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-8fa9aa2e-1000-4782-9a66-5082b2f7a733 tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] Returning 404 to user: Volume 045e9cf6-8980-4e34-a15c-dce7dcd7a806 could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:09:52.087567 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-8fa9aa2e-1000-4782-9a66-5082b2f7a733 tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] 10.222.0.55 "DELETE /compute/v2.1/os-volumes/045e9cf6-8980-4e34-a15c-dce7dcd7a806" status: 404 len: 109 microversion: 2.1 time: 0.035439 Jul 25 23:09:52.087567 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 366/724] 10.222.0.55 () {58 vars in 1248 bytes} [Mon Jul 25 23:09:52 2022] DELETE /compute/v2.1/os-volumes/045e9cf6-8980-4e34-a15c-dce7dcd7a806 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:09:52.091323 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-3b9ed6d9-749b-4d88-be62-5d9a08d29231 tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] Calling method '.version_select at 0x7f622f7bb9d0>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:52.119268 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.wsgi [None req-3b9ed6d9-749b-4d88-be62-5d9a08d29231 tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] HTTP exception thrown: Volume 045e9cf6-8980-4e34-a15c-dce7dcd7a806 could not be found. Jul 25 23:09:52.121257 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-3b9ed6d9-749b-4d88-be62-5d9a08d29231 tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] Request method failure captured: Jul 25 23:09:52.121257 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: request: GET /compute/v2.1/os-volumes/045e9cf6-8980-4e34-a15c-dce7dcd7a806 HTTP/1.1 Jul 25 23:09:52.121257 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept: application/json Jul 25 23:09:52.121257 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept-Encoding: identity Jul 25 23:09:52.121257 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Connection: close Jul 25 23:09:52.121257 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Length: 0 Jul 25 23:09:52.121257 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Type: application/json Jul 25 23:09:52.121257 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Host: 10.222.0.55 Jul 25 23:09:52.121257 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Openstack-System-Scope: None Jul 25 23:09:52.121257 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: User-Agent: python-urllib3/1.26.10 Jul 25 23:09:52.121257 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Auth-Token: gAAAAABi3yK36s7pjcxAmIrVBIAv2RO21_LOcraZJ92mwOBqgdIjUTYLUPBJkcR1EreM6QKj-ZSfhNLp-Qsu_7inzeNDQ6wVW65WZZkm7W9BtwTTsYNljrznjeASCTLEv3Ld91B26PSeVqVklr9l5BgsUW6yxpl0WBoqVvI8xjRmDYNRH1V4CnI Jul 25 23:09:52.121257 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Id: None Jul 25 23:09:52.121257 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Name: None Jul 25 23:09:52.121257 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Identity-Status: Confirmed Jul 25 23:09:52.121257 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Is-Admin-Project: True Jul 25 23:09:52.121257 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Id: default Jul 25 23:09:52.121257 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Name: Default Jul 25 23:09:52.121257 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Id: 2c8cb9af06ab4ab8aad85ded41095126 Jul 25 23:09:52.121257 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-558262901 Jul 25 23:09:52.121257 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Role: reader,member Jul 25 23:09:52.121257 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Roles: reader,member Jul 25 23:09:52.122776 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2c8cb9af06ab4ab8aad85ded41095126"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/2c8cb9af06ab4ab8aad85ded41095126"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_2c8cb9af06ab4ab8aad85ded41095126", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/2c8cb9af06ab4ab8aad85ded41095126"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:09:52.122776 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant: tempest-VolumesSnapshotsTestJSON-558262901 Jul 25 23:09:52.122776 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Id: 2c8cb9af06ab4ab8aad85ded41095126 Jul 25 23:09:52.122776 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-558262901 Jul 25 23:09:52.122776 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User: tempest-VolumesSnapshotsTestJSON-558262901-project Jul 25 23:09:52.122776 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Id: default Jul 25 23:09:52.122776 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Name: Default Jul 25 23:09:52.122776 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Id: 244806b9aaf24471a8cad381c1b71dfe Jul 25 23:09:52.122776 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Name: tempest-VolumesSnapshotsTestJSON-558262901-project Jul 25 23:09:52.122776 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: method: Jul 25 23:09:52.122776 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: exception: Volume 045e9cf6-8980-4e34-a15c-dce7dcd7a806 could not be found. Jul 25 23:09:52.122776 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: action_args: {'id': '045e9cf6-8980-4e34-a15c-dce7dcd7a806'} Jul 25 23:09:52.122776 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:09:52.123720 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:09:52.123720 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 23:09:52.123720 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 23:09:52.123720 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 23:09:52.123720 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 23:09:52.123720 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 23:09:52.123720 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 23:09:52.123720 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 23:09:52.123720 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 23:09:52.123720 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 23:09:52.123720 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 23:09:52.123720 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 23:09:52.123720 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 23:09:52.123720 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 23:09:52.123720 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 23:09:52.123720 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 045e9cf6-8980-4e34-a15c-dce7dcd7a806 could not be found. (HTTP 404) (Request-ID: req-831d08a9-dd55-41ac-b1dc-c1f7bc4b7d71) Jul 25 23:09:52.123720 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:09:52.123720 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:09:52.123720 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:09:52.125050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:09:52.125050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 25 23:09:52.125050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 25 23:09:52.125050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 25 23:09:52.125050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 25 23:09:52.125050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 25 23:09:52.125050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 25 23:09:52.125050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 25 23:09:52.125050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 25 23:09:52.125050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 25 23:09:52.125050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 25 23:09:52.125050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 25 23:09:52.125050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 25 23:09:52.125050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 25 23:09:52.125050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 25 23:09:52.125050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 25 23:09:52.125050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 25 23:09:52.125050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 25 23:09:52.125050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 25 23:09:52.126343 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 25 23:09:52.126343 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 25 23:09:52.126343 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 25 23:09:52.126343 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 25 23:09:52.126343 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 045e9cf6-8980-4e34-a15c-dce7dcd7a806 could not be found. Jul 25 23:09:52.126343 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:09:52.126343 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:09:52.126343 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:09:52.126343 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:09:52.126343 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:09:52.126343 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:09:52.126343 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:09:52.126343 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:09:52.126343 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 25 23:09:52.126343 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 25 23:09:52.126343 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:09:52.126343 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:09:52.126343 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 25 23:09:52.126343 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:09:52.127637 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 045e9cf6-8980-4e34-a15c-dce7dcd7a806 could not be found. Jul 25 23:09:52.127637 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:09:52.127637 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:09:52.127637 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:09:52.127637 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:09:52.127637 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:09:52.127637 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:09:52.127637 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:09:52.127637 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:09:52.127637 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 045e9cf6-8980-4e34-a15c-dce7dcd7a806 could not be found. Jul 25 23:09:52.127637 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:09:52.127637 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-3b9ed6d9-749b-4d88-be62-5d9a08d29231 tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] Returning 404 to user: Volume 045e9cf6-8980-4e34-a15c-dce7dcd7a806 could not be found. {{(pid=118409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:09:52.127637 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-3b9ed6d9-749b-4d88-be62-5d9a08d29231 tempest-VolumesSnapshotsTestJSON-558262901 tempest-VolumesSnapshotsTestJSON-558262901-project] 10.222.0.55 "GET /compute/v2.1/os-volumes/045e9cf6-8980-4e34-a15c-dce7dcd7a806" status: 404 len: 109 microversion: 2.1 time: 0.035472 Jul 25 23:09:52.127637 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 359/725] 10.222.0.55 () {58 vars in 1245 bytes} [Mon Jul 25 23:09:52 2022] GET /compute/v2.1/os-volumes/045e9cf6-8980-4e34-a15c-dce7dcd7a806 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:09:52.884298 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f310a928-6cf4-4a49-b5e0-a49f89330bb9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:52.885664 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f310a928-6cf4-4a49-b5e0-a49f89330bb9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:52.892134 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f310a928-6cf4-4a49-b5e0-a49f89330bb9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:52.892635 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f310a928-6cf4-4a49-b5e0-a49f89330bb9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:52.893609 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f310a928-6cf4-4a49-b5e0-a49f89330bb9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:52.894054 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f310a928-6cf4-4a49-b5e0-a49f89330bb9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:53.038763 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f310a928-6cf4-4a49-b5e0-a49f89330bb9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:53.047254 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f310a928-6cf4-4a49-b5e0-a49f89330bb9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:53.048762 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f310a928-6cf4-4a49-b5e0-a49f89330bb9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:53.049972 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f310a928-6cf4-4a49-b5e0-a49f89330bb9 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1723 microversion: 2.20 time: 0.171052 Jul 25 23:09:53.050505 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 367/726] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:09:52 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:09:54.076490 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-f59cfbe5-7596-4d35-8630-5fd723235d2a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:54.076490 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-f59cfbe5-7596-4d35-8630-5fd723235d2a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:54.081852 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f59cfbe5-7596-4d35-8630-5fd723235d2a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:54.082298 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f59cfbe5-7596-4d35-8630-5fd723235d2a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:54.083793 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f59cfbe5-7596-4d35-8630-5fd723235d2a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:54.083793 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f59cfbe5-7596-4d35-8630-5fd723235d2a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:54.090646 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:09:54.223164 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-f59cfbe5-7596-4d35-8630-5fd723235d2a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:54.231123 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-f59cfbe5-7596-4d35-8630-5fd723235d2a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:54.232618 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-f59cfbe5-7596-4d35-8630-5fd723235d2a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:54.233802 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-f59cfbe5-7596-4d35-8630-5fd723235d2a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1723 microversion: 2.20 time: 0.163793 Jul 25 23:09:54.234529 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 360/727] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:09:54 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:09:55.257715 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-de6eebf3-6050-4f22-9e95-bd51c2d3bbde tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:55.258342 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-de6eebf3-6050-4f22-9e95-bd51c2d3bbde tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:55.264705 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-de6eebf3-6050-4f22-9e95-bd51c2d3bbde tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:55.265171 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-de6eebf3-6050-4f22-9e95-bd51c2d3bbde tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:55.265928 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-de6eebf3-6050-4f22-9e95-bd51c2d3bbde tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:55.266353 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-de6eebf3-6050-4f22-9e95-bd51c2d3bbde tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:55.405243 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-de6eebf3-6050-4f22-9e95-bd51c2d3bbde tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:55.414202 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-de6eebf3-6050-4f22-9e95-bd51c2d3bbde tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:55.415810 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-de6eebf3-6050-4f22-9e95-bd51c2d3bbde tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:55.417054 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-de6eebf3-6050-4f22-9e95-bd51c2d3bbde tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1723 microversion: 2.20 time: 0.163933 Jul 25 23:09:55.417647 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 368/728] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:09:55 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:09:56.441197 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-e1be9608-4e86-4aeb-9c5c-6e41504e9bf0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:56.441803 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-e1be9608-4e86-4aeb-9c5c-6e41504e9bf0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:56.448739 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e1be9608-4e86-4aeb-9c5c-6e41504e9bf0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:56.449228 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e1be9608-4e86-4aeb-9c5c-6e41504e9bf0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:56.449994 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e1be9608-4e86-4aeb-9c5c-6e41504e9bf0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:56.450448 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e1be9608-4e86-4aeb-9c5c-6e41504e9bf0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:56.580980 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-e1be9608-4e86-4aeb-9c5c-6e41504e9bf0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:56.589892 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-e1be9608-4e86-4aeb-9c5c-6e41504e9bf0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:56.591397 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-e1be9608-4e86-4aeb-9c5c-6e41504e9bf0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:56.592549 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-e1be9608-4e86-4aeb-9c5c-6e41504e9bf0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1723 microversion: 2.20 time: 0.155405 Jul 25 23:09:56.593109 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 361/729] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:09:56 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:09:57.615805 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-372f2fb6-d159-4e6a-9525-aad4781f042a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:57.616407 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-372f2fb6-d159-4e6a-9525-aad4781f042a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:57.624989 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-372f2fb6-d159-4e6a-9525-aad4781f042a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:57.625467 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-372f2fb6-d159-4e6a-9525-aad4781f042a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:57.626665 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-372f2fb6-d159-4e6a-9525-aad4781f042a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:57.627110 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-372f2fb6-d159-4e6a-9525-aad4781f042a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:57.767043 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-372f2fb6-d159-4e6a-9525-aad4781f042a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:57.775516 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-372f2fb6-d159-4e6a-9525-aad4781f042a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:57.777144 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-372f2fb6-d159-4e6a-9525-aad4781f042a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:57.778321 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-372f2fb6-d159-4e6a-9525-aad4781f042a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1723 microversion: 2.20 time: 0.166382 Jul 25 23:09:57.778875 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 369/730] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:09:57 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:09:58.802438 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-966d14b9-3fcd-4bc5-8a64-0d3332597209 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:58.803036 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-966d14b9-3fcd-4bc5-8a64-0d3332597209 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:58.809603 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-966d14b9-3fcd-4bc5-8a64-0d3332597209 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:58.810217 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-966d14b9-3fcd-4bc5-8a64-0d3332597209 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:58.811361 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-966d14b9-3fcd-4bc5-8a64-0d3332597209 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:58.811799 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-966d14b9-3fcd-4bc5-8a64-0d3332597209 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:58.950000 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-966d14b9-3fcd-4bc5-8a64-0d3332597209 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:58.954783 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-966d14b9-3fcd-4bc5-8a64-0d3332597209 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:58.956260 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-966d14b9-3fcd-4bc5-8a64-0d3332597209 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:09:58.957499 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-966d14b9-3fcd-4bc5-8a64-0d3332597209 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1723 microversion: 2.20 time: 0.159151 Jul 25 23:09:58.958044 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 362/731] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:09:58 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:09:59.390533 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c9c2bb7d-6938-42ad-95b9-2b2647a359f9 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:59.391122 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c9c2bb7d-6938-42ad-95b9-2b2647a359f9 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:59.397818 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c9c2bb7d-6938-42ad-95b9-2b2647a359f9 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:59.398294 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c9c2bb7d-6938-42ad-95b9-2b2647a359f9 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:59.399081 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c9c2bb7d-6938-42ad-95b9-2b2647a359f9 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:59.400114 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c9c2bb7d-6938-42ad-95b9-2b2647a359f9 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:59.423483 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c9c2bb7d-6938-42ad-95b9-2b2647a359f9 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9/ips" status: 200 len: 146 microversion: 2.1 time: 0.036872 Jul 25 23:09:59.424058 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 370/732] 10.222.0.55 () {58 vars in 1248 bytes} [Mon Jul 25 23:09:59 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9/ips => generated 146 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:09:59.981288 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-693d30c0-b7f8-4fa5-8ee5-94f940a136e0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:09:59.981914 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-693d30c0-b7f8-4fa5-8ee5-94f940a136e0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:09:59.988388 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-693d30c0-b7f8-4fa5-8ee5-94f940a136e0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:59.988862 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-693d30c0-b7f8-4fa5-8ee5-94f940a136e0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:09:59.989658 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-693d30c0-b7f8-4fa5-8ee5-94f940a136e0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:09:59.990087 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-693d30c0-b7f8-4fa5-8ee5-94f940a136e0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:00.127684 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-693d30c0-b7f8-4fa5-8ee5-94f940a136e0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:00.137242 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-693d30c0-b7f8-4fa5-8ee5-94f940a136e0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:00.137548 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-693d30c0-b7f8-4fa5-8ee5-94f940a136e0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:00.138737 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-693d30c0-b7f8-4fa5-8ee5-94f940a136e0 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1723 microversion: 2.20 time: 0.161869 Jul 25 23:10:00.139561 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 363/733] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:09:59 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:10:01.088504 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-1cfc465f-a3dc-42c6-b3d3-e29cc04a7125 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8a183312-c90d-4044-a5ef-04560680a605"}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:10:01.090956 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-1cfc465f-a3dc-42c6-b3d3-e29cc04a7125 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:01.097384 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1cfc465f-a3dc-42c6-b3d3-e29cc04a7125 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:01.098036 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1cfc465f-a3dc-42c6-b3d3-e29cc04a7125 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:01.098959 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1cfc465f-a3dc-42c6-b3d3-e29cc04a7125 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:01.105033 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1cfc465f-a3dc-42c6-b3d3-e29cc04a7125 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:01.163550 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-f752087c-70ee-4794-8c5f-e4c382e05b3e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:01.168161 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-f752087c-70ee-4794-8c5f-e4c382e05b3e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:01.171794 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f752087c-70ee-4794-8c5f-e4c382e05b3e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:01.172239 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f752087c-70ee-4794-8c5f-e4c382e05b3e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:01.173006 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f752087c-70ee-4794-8c5f-e4c382e05b3e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:01.173513 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f752087c-70ee-4794-8c5f-e4c382e05b3e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:01.314195 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-f752087c-70ee-4794-8c5f-e4c382e05b3e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:01.323277 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-f752087c-70ee-4794-8c5f-e4c382e05b3e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:01.324757 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-f752087c-70ee-4794-8c5f-e4c382e05b3e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:01.325936 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-f752087c-70ee-4794-8c5f-e4c382e05b3e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1723 microversion: 2.20 time: 0.166979 Jul 25 23:10:01.326706 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 364/734] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:10:01 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:10:01.918921 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:02.123872 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-1cfc465f-a3dc-42c6-b3d3-e29cc04a7125 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "POST /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.039862 Jul 25 23:10:02.124597 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 371/735] 10.222.0.55 () {60 vars in 1323 bytes} [Mon Jul 25 23:10:01 2022] POST /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9/os-volume_attachments => generated 194 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:10:02.350134 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-efe9cc0b-9827-48c1-a16e-242ae25c9a95 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:02.351341 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-efe9cc0b-9827-48c1-a16e-242ae25c9a95 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:02.358521 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-efe9cc0b-9827-48c1-a16e-242ae25c9a95 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:02.359174 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-efe9cc0b-9827-48c1-a16e-242ae25c9a95 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:02.359938 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-efe9cc0b-9827-48c1-a16e-242ae25c9a95 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:02.360557 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-efe9cc0b-9827-48c1-a16e-242ae25c9a95 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:02.741789 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-efe9cc0b-9827-48c1-a16e-242ae25c9a95 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:02.750729 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-efe9cc0b-9827-48c1-a16e-242ae25c9a95 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:02.754790 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-efe9cc0b-9827-48c1-a16e-242ae25c9a95 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:02.754790 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-efe9cc0b-9827-48c1-a16e-242ae25c9a95 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1744 microversion: 2.20 time: 0.407083 Jul 25 23:10:02.754790 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 365/736] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:10:02 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1744 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:10:03.780268 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-be0592cf-f84b-4120-a4ea-e3c78fd885d8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:03.780884 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-be0592cf-f84b-4120-a4ea-e3c78fd885d8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:03.788212 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-be0592cf-f84b-4120-a4ea-e3c78fd885d8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:03.788660 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-be0592cf-f84b-4120-a4ea-e3c78fd885d8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:03.789458 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-be0592cf-f84b-4120-a4ea-e3c78fd885d8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:03.790062 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-be0592cf-f84b-4120-a4ea-e3c78fd885d8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:03.939272 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-be0592cf-f84b-4120-a4ea-e3c78fd885d8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:03.948465 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-be0592cf-f84b-4120-a4ea-e3c78fd885d8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:03.950169 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-be0592cf-f84b-4120-a4ea-e3c78fd885d8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:03.951660 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-be0592cf-f84b-4120-a4ea-e3c78fd885d8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1744 microversion: 2.20 time: 0.175822 Jul 25 23:10:03.952329 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 372/737] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:10:03 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1744 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:10:04.976159 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-8153595a-6b31-4037-bb34-88e8a5801b06 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:04.976773 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-8153595a-6b31-4037-bb34-88e8a5801b06 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:04.979185 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_api:SELECT=22 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:04.984045 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8153595a-6b31-4037-bb34-88e8a5801b06 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:04.984490 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8153595a-6b31-4037-bb34-88e8a5801b06 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:04.985435 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8153595a-6b31-4037-bb34-88e8a5801b06 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:04.985876 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8153595a-6b31-4037-bb34-88e8a5801b06 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:05.135041 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-8153595a-6b31-4037-bb34-88e8a5801b06 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:05.143316 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-8153595a-6b31-4037-bb34-88e8a5801b06 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:05.144828 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-8153595a-6b31-4037-bb34-88e8a5801b06 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:05.146353 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-8153595a-6b31-4037-bb34-88e8a5801b06 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1739 microversion: 2.20 time: 0.174510 Jul 25 23:10:05.146913 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 366/738] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:10:04 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:10:06.131766 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-8fb34347-588f-471c-8c6f-a1b26ca5104c req-f32db389-545c-402b-9f2e-3b4806b06a6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5f69472-1864-4211-b288-44e579367954", "name": "network-vif-plugged", "status": "completed", "tag": "c6685a7a-bff1-4d27-8daf-0e1614096b58"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:10:06.143287 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=30 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:06.148211 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-8fb34347-588f-471c-8c6f-a1b26ca5104c req-f32db389-545c-402b-9f2e-3b4806b06a6a service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:06.148743 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-8fb34347-588f-471c-8c6f-a1b26ca5104c req-f32db389-545c-402b-9f2e-3b4806b06a6a service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:06.165598 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-8fb34347-588f-471c-8c6f-a1b26ca5104c req-f32db389-545c-402b-9f2e-3b4806b06a6a service nova] Creating event network-vif-plugged:c6685a7a-bff1-4d27-8daf-0e1614096b58 for instance c5f69472-1864-4211-b288-44e579367954 on hv-cinder-79760 Jul 25 23:10:06.171650 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-8fb34347-588f-471c-8c6f-a1b26ca5104c req-f32db389-545c-402b-9f2e-3b4806b06a6a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.258378 Jul 25 23:10:06.172774 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 373/739] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:10:06.175170 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-0620f108-3c8f-43f1-a472-bfccb6da9667 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:06.176508 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-0620f108-3c8f-43f1-a472-bfccb6da9667 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:06.186246 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0620f108-3c8f-43f1-a472-bfccb6da9667 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:06.186995 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0620f108-3c8f-43f1-a472-bfccb6da9667 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:06.188037 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0620f108-3c8f-43f1-a472-bfccb6da9667 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:06.188475 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0620f108-3c8f-43f1-a472-bfccb6da9667 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:06.381267 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-0620f108-3c8f-43f1-a472-bfccb6da9667 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:06.410415 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-0620f108-3c8f-43f1-a472-bfccb6da9667 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:06.413722 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-0620f108-3c8f-43f1-a472-bfccb6da9667 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:06.416231 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-0620f108-3c8f-43f1-a472-bfccb6da9667 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1739 microversion: 2.20 time: 0.245439 Jul 25 23:10:06.419984 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 367/740] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:10:06 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1739 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:10:07.441990 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-bb4feeb2-4ff3-45ae-a899-21e37de677d3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:07.443627 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-bb4feeb2-4ff3-45ae-a899-21e37de677d3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:07.450998 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bb4feeb2-4ff3-45ae-a899-21e37de677d3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:07.451612 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bb4feeb2-4ff3-45ae-a899-21e37de677d3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:07.452714 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bb4feeb2-4ff3-45ae-a899-21e37de677d3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:07.453432 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bb4feeb2-4ff3-45ae-a899-21e37de677d3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:07.620543 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-bb4feeb2-4ff3-45ae-a899-21e37de677d3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:07.632001 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-bb4feeb2-4ff3-45ae-a899-21e37de677d3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:07.634704 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-bb4feeb2-4ff3-45ae-a899-21e37de677d3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:07.635773 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-bb4feeb2-4ff3-45ae-a899-21e37de677d3 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1739 microversion: 2.20 time: 0.199138 Jul 25 23:10:07.636326 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 374/741] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:10:07 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:10:08.661595 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-b42b41f0-0210-4875-a81f-5c89c1b0b186 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:08.662257 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-b42b41f0-0210-4875-a81f-5c89c1b0b186 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:08.669722 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b42b41f0-0210-4875-a81f-5c89c1b0b186 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:08.670244 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b42b41f0-0210-4875-a81f-5c89c1b0b186 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:08.671122 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b42b41f0-0210-4875-a81f-5c89c1b0b186 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:08.671586 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b42b41f0-0210-4875-a81f-5c89c1b0b186 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:08.810479 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-b42b41f0-0210-4875-a81f-5c89c1b0b186 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:08.822945 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-b42b41f0-0210-4875-a81f-5c89c1b0b186 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:08.822945 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-b42b41f0-0210-4875-a81f-5c89c1b0b186 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:08.823560 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-b42b41f0-0210-4875-a81f-5c89c1b0b186 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1739 microversion: 2.20 time: 0.166774 Jul 25 23:10:08.824389 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 368/742] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:10:08 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:10:09.801386 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0ca80728-f18b-4d35-9942-6fe1de6895fb tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:09.804266 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-0ca80728-f18b-4d35-9942-6fe1de6895fb tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:09.812061 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0ca80728-f18b-4d35-9942-6fe1de6895fb tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:09.816788 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0ca80728-f18b-4d35-9942-6fe1de6895fb tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:09.816788 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0ca80728-f18b-4d35-9942-6fe1de6895fb tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:09.816788 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0ca80728-f18b-4d35-9942-6fe1de6895fb tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:09.847460 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-bf274a8f-08ff-45d7-9a35-26a305475a3b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:09.849560 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-bf274a8f-08ff-45d7-9a35-26a305475a3b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:09.856166 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-bf274a8f-08ff-45d7-9a35-26a305475a3b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:09.856861 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-bf274a8f-08ff-45d7-9a35-26a305475a3b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:09.857469 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-0ca80728-f18b-4d35-9942-6fe1de6895fb tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059797 Jul 25 23:10:09.858056 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-bf274a8f-08ff-45d7-9a35-26a305475a3b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:09.858640 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-bf274a8f-08ff-45d7-9a35-26a305475a3b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:09.867654 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 375/743] 10.222.0.55 () {58 vars in 1302 bytes} [Mon Jul 25 23:10:09 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:10:09.874291 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-7c41faa5-d510-480c-9864-05ec91439f18 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:09.874924 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-7c41faa5-d510-480c-9864-05ec91439f18 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:09.881879 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7c41faa5-d510-480c-9864-05ec91439f18 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:09.882519 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7c41faa5-d510-480c-9864-05ec91439f18 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:09.883989 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7c41faa5-d510-480c-9864-05ec91439f18 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:09.884524 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7c41faa5-d510-480c-9864-05ec91439f18 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:09.920796 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-7c41faa5-d510-480c-9864-05ec91439f18 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9/os-volume_attachments/8a183312-c90d-4044-a5ef-04560680a605" status: 200 len: 194 microversion: 2.1 time: 0.051511 Jul 25 23:10:09.921430 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 376/744] 10.222.0.55 () {58 vars in 1413 bytes} [Mon Jul 25 23:10:09 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9/os-volume_attachments/8a183312-c90d-4044-a5ef-04560680a605 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:10:10.028583 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-bf274a8f-08ff-45d7-9a35-26a305475a3b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:10.039665 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-bf274a8f-08ff-45d7-9a35-26a305475a3b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:10.042697 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-bf274a8f-08ff-45d7-9a35-26a305475a3b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:10.045456 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-bf274a8f-08ff-45d7-9a35-26a305475a3b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1739 microversion: 2.20 time: 0.201276 Jul 25 23:10:10.046673 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 369/745] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:10:09 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:10:11.070823 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-dca7b5ba-1d76-474b-afd0-d103bc1477f6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:11.072068 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-dca7b5ba-1d76-474b-afd0-d103bc1477f6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:11.078919 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dca7b5ba-1d76-474b-afd0-d103bc1477f6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:11.079371 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dca7b5ba-1d76-474b-afd0-d103bc1477f6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:11.080171 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dca7b5ba-1d76-474b-afd0-d103bc1477f6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:11.080908 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dca7b5ba-1d76-474b-afd0-d103bc1477f6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:11.250180 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-dca7b5ba-1d76-474b-afd0-d103bc1477f6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:11.261405 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-dca7b5ba-1d76-474b-afd0-d103bc1477f6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:11.263216 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-dca7b5ba-1d76-474b-afd0-d103bc1477f6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:11.264646 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-dca7b5ba-1d76-474b-afd0-d103bc1477f6 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1739 microversion: 2.20 time: 0.197932 Jul 25 23:10:11.265766 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 377/746] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:10:11 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:10:11.730874 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-830dde44-4c6f-4825-a63f-c563fe85e332 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6107bf5-d43f-476c-9209-35e9c2733ccb"}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:10:11.734251 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-830dde44-4c6f-4825-a63f-c563fe85e332 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:11.740995 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-830dde44-4c6f-4825-a63f-c563fe85e332 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:11.741541 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-830dde44-4c6f-4825-a63f-c563fe85e332 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:11.869270 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-830dde44-4c6f-4825-a63f-c563fe85e332 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:11.869270 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-830dde44-4c6f-4825-a63f-c563fe85e332 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:12.288017 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-8a167308-711f-4520-a251-472660540858 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:12.288603 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-8a167308-711f-4520-a251-472660540858 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:12.295909 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8a167308-711f-4520-a251-472660540858 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:12.296363 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8a167308-711f-4520-a251-472660540858 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:12.297521 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8a167308-711f-4520-a251-472660540858 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:12.298264 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8a167308-711f-4520-a251-472660540858 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:12.497220 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-8a167308-711f-4520-a251-472660540858 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:12.509807 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-8a167308-711f-4520-a251-472660540858 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:12.512339 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-8a167308-711f-4520-a251-472660540858 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:12.513687 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-8a167308-711f-4520-a251-472660540858 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1739 microversion: 2.20 time: 0.229652 Jul 25 23:10:12.514348 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 378/747] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:10:12 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1739 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:10:12.632786 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-830dde44-4c6f-4825-a63f-c563fe85e332 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "POST /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.906404 Jul 25 23:10:12.635168 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 370/748] 10.222.0.55 () {60 vars in 1323 bytes} [Mon Jul 25 23:10:11 2022] POST /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9/os-volume_attachments => generated 194 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:10:13.546011 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-50ae4534-35d7-42e4-8573-3bba2f552692 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:13.547189 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-50ae4534-35d7-42e4-8573-3bba2f552692 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:13.554829 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-50ae4534-35d7-42e4-8573-3bba2f552692 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:13.555543 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-50ae4534-35d7-42e4-8573-3bba2f552692 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:13.556281 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-50ae4534-35d7-42e4-8573-3bba2f552692 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:13.556649 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-50ae4534-35d7-42e4-8573-3bba2f552692 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:13.698536 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-50ae4534-35d7-42e4-8573-3bba2f552692 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:13.713090 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-50ae4534-35d7-42e4-8573-3bba2f552692 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:13.716504 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-50ae4534-35d7-42e4-8573-3bba2f552692 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:13.717800 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-50ae4534-35d7-42e4-8573-3bba2f552692 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1739 microversion: 2.20 time: 0.176141 Jul 25 23:10:13.718358 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 379/749] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:10:13 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:10:14.745317 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-fca7f311-018b-4b7b-9cd4-c561a460989f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:14.746165 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-fca7f311-018b-4b7b-9cd4-c561a460989f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:14.757341 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-fca7f311-018b-4b7b-9cd4-c561a460989f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:14.758289 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-fca7f311-018b-4b7b-9cd4-c561a460989f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:14.760292 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-fca7f311-018b-4b7b-9cd4-c561a460989f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:14.761382 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-fca7f311-018b-4b7b-9cd4-c561a460989f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:14.976284 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-fca7f311-018b-4b7b-9cd4-c561a460989f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:14.976284 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-fca7f311-018b-4b7b-9cd4-c561a460989f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:14.977079 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-fca7f311-018b-4b7b-9cd4-c561a460989f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:14.977079 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-fca7f311-018b-4b7b-9cd4-c561a460989f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1739 microversion: 2.20 time: 0.222728 Jul 25 23:10:14.977079 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 371/750] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:10:14 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1739 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:10:15.987811 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-ecdcd930-0c7e-4b5c-99a1-efc44b8c3a7b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:15.989200 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-ecdcd930-0c7e-4b5c-99a1-efc44b8c3a7b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:15.996173 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ecdcd930-0c7e-4b5c-99a1-efc44b8c3a7b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:15.996877 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ecdcd930-0c7e-4b5c-99a1-efc44b8c3a7b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:15.998051 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ecdcd930-0c7e-4b5c-99a1-efc44b8c3a7b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:15.998650 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ecdcd930-0c7e-4b5c-99a1-efc44b8c3a7b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:16.137071 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ecdcd930-0c7e-4b5c-99a1-efc44b8c3a7b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:16.145346 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ecdcd930-0c7e-4b5c-99a1-efc44b8c3a7b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:16.147085 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ecdcd930-0c7e-4b5c-99a1-efc44b8c3a7b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:16.148263 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-ecdcd930-0c7e-4b5c-99a1-efc44b8c3a7b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1739 microversion: 2.20 time: 0.164389 Jul 25 23:10:16.149520 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 380/751] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:10:15 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1739 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:10:17.176500 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-939c9db3-606e-4601-b91d-2405b10030bd tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:17.177267 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-939c9db3-606e-4601-b91d-2405b10030bd tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:17.186387 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-939c9db3-606e-4601-b91d-2405b10030bd tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:17.187011 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-939c9db3-606e-4601-b91d-2405b10030bd tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:17.187915 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-939c9db3-606e-4601-b91d-2405b10030bd tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:17.188405 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-939c9db3-606e-4601-b91d-2405b10030bd tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:17.341365 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-939c9db3-606e-4601-b91d-2405b10030bd tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:17.351664 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-939c9db3-606e-4601-b91d-2405b10030bd tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:17.353781 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-939c9db3-606e-4601-b91d-2405b10030bd tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:17.356337 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-939c9db3-606e-4601-b91d-2405b10030bd tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1721 microversion: 2.20 time: 0.184748 Jul 25 23:10:17.356894 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 372/752] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:10:17 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:10:18.382422 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b6bae9dd-222a-494e-9234-45a673219983 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:18.383010 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b6bae9dd-222a-494e-9234-45a673219983 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:18.390396 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b6bae9dd-222a-494e-9234-45a673219983 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:18.390838 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b6bae9dd-222a-494e-9234-45a673219983 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:18.391597 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b6bae9dd-222a-494e-9234-45a673219983 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:18.392025 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b6bae9dd-222a-494e-9234-45a673219983 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:18.529285 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b6bae9dd-222a-494e-9234-45a673219983 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:18.537367 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b6bae9dd-222a-494e-9234-45a673219983 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:18.538862 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b6bae9dd-222a-494e-9234-45a673219983 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:18.540350 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b6bae9dd-222a-494e-9234-45a673219983 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1721 microversion: 2.20 time: 0.161650 Jul 25 23:10:18.540898 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 381/753] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:10:18 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:10:19.563626 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-802d1901-a072-4697-8085-ec1e014788c8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:19.566024 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-802d1901-a072-4697-8085-ec1e014788c8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:19.572372 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-802d1901-a072-4697-8085-ec1e014788c8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:19.572816 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-802d1901-a072-4697-8085-ec1e014788c8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:19.573614 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-802d1901-a072-4697-8085-ec1e014788c8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:19.574043 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-802d1901-a072-4697-8085-ec1e014788c8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:19.718929 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-802d1901-a072-4697-8085-ec1e014788c8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:19.727046 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-802d1901-a072-4697-8085-ec1e014788c8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:19.728701 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-802d1901-a072-4697-8085-ec1e014788c8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:19.729881 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-802d1901-a072-4697-8085-ec1e014788c8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1721 microversion: 2.20 time: 0.170228 Jul 25 23:10:19.733304 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 373/754] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:10:19 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:10:19.955598 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-3a09cab5-f39d-4762-bce4-ef12be867dd5 req-d07ca16e-cbaa-47bd-bfac-f39a702b4b56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5f69472-1864-4211-b288-44e579367954", "name": "network-vif-unplugged", "status": "completed", "tag": "c6685a7a-bff1-4d27-8daf-0e1614096b58"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:10:19.965520 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-3a09cab5-f39d-4762-bce4-ef12be867dd5 req-d07ca16e-cbaa-47bd-bfac-f39a702b4b56 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:19.965958 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-3a09cab5-f39d-4762-bce4-ef12be867dd5 req-d07ca16e-cbaa-47bd-bfac-f39a702b4b56 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:19.977515 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-3a09cab5-f39d-4762-bce4-ef12be867dd5 req-d07ca16e-cbaa-47bd-bfac-f39a702b4b56 service nova] Creating event network-vif-unplugged:c6685a7a-bff1-4d27-8daf-0e1614096b58 for instance c5f69472-1864-4211-b288-44e579367954 on hv-cinder-79760 Jul 25 23:10:19.982600 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-3a09cab5-f39d-4762-bce4-ef12be867dd5 req-d07ca16e-cbaa-47bd-bfac-f39a702b4b56 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030564 Jul 25 23:10:19.983188 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 382/755] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:10:20.753680 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-6778e26f-d7e1-4e8f-8090-ec3f08b22e4d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:20.754515 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-6778e26f-d7e1-4e8f-8090-ec3f08b22e4d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:20.761969 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6778e26f-d7e1-4e8f-8090-ec3f08b22e4d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:20.767154 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6778e26f-d7e1-4e8f-8090-ec3f08b22e4d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:20.767154 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6778e26f-d7e1-4e8f-8090-ec3f08b22e4d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:20.767154 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6778e26f-d7e1-4e8f-8090-ec3f08b22e4d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:20.900498 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-6778e26f-d7e1-4e8f-8090-ec3f08b22e4d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:20.909616 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-6778e26f-d7e1-4e8f-8090-ec3f08b22e4d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:20.911197 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-6778e26f-d7e1-4e8f-8090-ec3f08b22e4d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:20.920898 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-6778e26f-d7e1-4e8f-8090-ec3f08b22e4d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1724 microversion: 2.20 time: 0.162492 Jul 25 23:10:20.920898 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 374/756] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:10:20 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:10:20.936468 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5a355f84-51cb-418e-859f-8edaf0aa9135 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60420745-e7ef-45de-a370-3129a43498dc"}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:10:20.938940 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-5a355f84-51cb-418e-859f-8edaf0aa9135 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:20.946148 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5a355f84-51cb-418e-859f-8edaf0aa9135 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:20.949709 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5a355f84-51cb-418e-859f-8edaf0aa9135 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:20.949709 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5a355f84-51cb-418e-859f-8edaf0aa9135 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:20.949709 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5a355f84-51cb-418e-859f-8edaf0aa9135 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:21.328897 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-8e1fd735-8be8-4d0e-b876-bbb29528f72e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:21.331182 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-8e1fd735-8be8-4d0e-b876-bbb29528f72e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:21.337612 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8e1fd735-8be8-4d0e-b876-bbb29528f72e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:21.338050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8e1fd735-8be8-4d0e-b876-bbb29528f72e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:21.338878 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8e1fd735-8be8-4d0e-b876-bbb29528f72e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:21.339316 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8e1fd735-8be8-4d0e-b876-bbb29528f72e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:21.354517 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:21.371957 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-8e1fd735-8be8-4d0e-b876-bbb29528f72e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047009 Jul 25 23:10:21.372521 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 375/757] 10.222.0.55 () {58 vars in 1302 bytes} [Mon Jul 25 23:10:21 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:10:21.523294 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-9f7587a3-682a-422a-a88b-7c99bf1fae23 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:21.523799 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-9f7587a3-682a-422a-a88b-7c99bf1fae23 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:21.530643 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9f7587a3-682a-422a-a88b-7c99bf1fae23 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:21.531084 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9f7587a3-682a-422a-a88b-7c99bf1fae23 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:21.531832 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9f7587a3-682a-422a-a88b-7c99bf1fae23 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:21.532257 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9f7587a3-682a-422a-a88b-7c99bf1fae23 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:21.562895 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-9f7587a3-682a-422a-a88b-7c99bf1fae23 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9/os-volume_attachments/8a183312-c90d-4044-a5ef-04560680a605" status: 200 len: 194 microversion: 2.1 time: 0.044014 Jul 25 23:10:21.563495 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 376/758] 10.222.0.55 () {58 vars in 1413 bytes} [Mon Jul 25 23:10:21 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9/os-volume_attachments/8a183312-c90d-4044-a5ef-04560680a605 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 23:10:21.574729 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-c60a633d-dde6-4433-aee4-fb59004f7b7c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:21.575212 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-c60a633d-dde6-4433-aee4-fb59004f7b7c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:21.582377 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c60a633d-dde6-4433-aee4-fb59004f7b7c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:21.582799 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c60a633d-dde6-4433-aee4-fb59004f7b7c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:21.583567 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c60a633d-dde6-4433-aee4-fb59004f7b7c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:21.584016 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c60a633d-dde6-4433-aee4-fb59004f7b7c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:21.668256 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.objects.instance [None req-c60a633d-dde6-4433-aee4-fb59004f7b7c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lazy-loading 'services' on Instance uuid ccd6191d-8bbf-4ecb-803e-ca7e713501a9 {{(pid=118409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 23:10:21.936263 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-c60a633d-dde6-4433-aee4-fb59004f7b7c tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9/os-volume_attachments/8a183312-c90d-4044-a5ef-04560680a605" status: 202 len: 0 microversion: 2.1 time: 0.366197 Jul 25 23:10:21.936972 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 377/759] 10.222.0.55 () {58 vars in 1416 bytes} [Mon Jul 25 23:10:21 2022] DELETE /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9/os-volume_attachments/8a183312-c90d-4044-a5ef-04560680a605 => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 25 23:10:21.965462 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-5a355f84-51cb-418e-859f-8edaf0aa9135 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "POST /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.033379 Jul 25 23:10:21.966535 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 383/760] 10.222.0.55 () {62 vars in 1364 bytes} [Mon Jul 25 23:10:20 2022] POST /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954/os-volume_attachments => generated 188 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 25 23:10:22.101364 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-82fe0ae6-b4a4-4438-a966-b41527460818 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:22.102750 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-82fe0ae6-b4a4-4438-a966-b41527460818 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:22.109182 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-82fe0ae6-b4a4-4438-a966-b41527460818 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:22.109728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-82fe0ae6-b4a4-4438-a966-b41527460818 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:22.110563 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-82fe0ae6-b4a4-4438-a966-b41527460818 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:22.111072 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-82fe0ae6-b4a4-4438-a966-b41527460818 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:22.791265 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-82fe0ae6-b4a4-4438-a966-b41527460818 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "DELETE /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954/os-volume_attachments/60420745-e7ef-45de-a370-3129a43498dc" status: 202 len: 0 microversion: 2.20 time: 0.694144 Jul 25 23:10:22.791876 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 378/761] 10.222.0.55 () {60 vars in 1457 bytes} [Mon Jul 25 23:10:22 2022] DELETE /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954/os-volume_attachments/60420745-e7ef-45de-a370-3129a43498dc => generated 0 bytes in 696 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 23:10:22.854206 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-551b62a9-7010-4b0b-b903-10e50118765b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:10:22.854773 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-551b62a9-7010-4b0b-b903-10e50118765b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:22.862375 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-551b62a9-7010-4b0b-b903-10e50118765b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:22.863126 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-551b62a9-7010-4b0b-b903-10e50118765b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:22.863498 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-551b62a9-7010-4b0b-b903-10e50118765b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:22.863863 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-551b62a9-7010-4b0b-b903-10e50118765b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:23.146576 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-551b62a9-7010-4b0b-b903-10e50118765b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "POST /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954/action" status: 202 len: 0 microversion: 2.20 time: 0.296015 Jul 25 23:10:23.147435 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 384/762] 10.222.0.55 () {62 vars in 1319 bytes} [Mon Jul 25 23:10:22 2022] POST /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 25 23:10:23.155366 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-5cc0fbb8-64c8-4e14-ab12-5ce2a89c5a30 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:23.155931 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-5cc0fbb8-64c8-4e14-ab12-5ce2a89c5a30 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:23.164506 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5cc0fbb8-64c8-4e14-ab12-5ce2a89c5a30 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:23.166622 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5cc0fbb8-64c8-4e14-ab12-5ce2a89c5a30 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:23.166622 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5cc0fbb8-64c8-4e14-ab12-5ce2a89c5a30 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:23.166986 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5cc0fbb8-64c8-4e14-ab12-5ce2a89c5a30 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:23.330737 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-5cc0fbb8-64c8-4e14-ab12-5ce2a89c5a30 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:23.339051 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-5cc0fbb8-64c8-4e14-ab12-5ce2a89c5a30 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:23.340545 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-5cc0fbb8-64c8-4e14-ab12-5ce2a89c5a30 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:23.344078 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-5cc0fbb8-64c8-4e14-ab12-5ce2a89c5a30 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1672 microversion: 2.20 time: 0.190535 Jul 25 23:10:23.344078 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 379/763] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:10:23 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1672 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:10:24.126561 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-09480af9-17b4-4d27-9852-db8fe05e3cb2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:24.127246 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-09480af9-17b4-4d27-9852-db8fe05e3cb2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:24.134080 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-09480af9-17b4-4d27-9852-db8fe05e3cb2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:24.134606 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-09480af9-17b4-4d27-9852-db8fe05e3cb2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:24.135380 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-09480af9-17b4-4d27-9852-db8fe05e3cb2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:24.135807 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-09480af9-17b4-4d27-9852-db8fe05e3cb2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:24.156053 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:UPDATE=6,nova_cell1:SELECT=89,nova_cell1:INSERT=5 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:24.169941 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-09480af9-17b4-4d27-9852-db8fe05e3cb2 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9/os-volume_attachments/e6107bf5-d43f-476c-9209-35e9c2733ccb" status: 200 len: 194 microversion: 2.1 time: 0.047383 Jul 25 23:10:24.170543 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 385/764] 10.222.0.55 () {58 vars in 1413 bytes} [Mon Jul 25 23:10:24 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9/os-volume_attachments/e6107bf5-d43f-476c-9209-35e9c2733ccb => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:10:24.183633 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-0a3d8024-0ad1-4d24-8ce5-a607d0fced36 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:24.183633 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-0a3d8024-0ad1-4d24-8ce5-a607d0fced36 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:24.189541 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0a3d8024-0ad1-4d24-8ce5-a607d0fced36 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:24.189995 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0a3d8024-0ad1-4d24-8ce5-a607d0fced36 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:24.191981 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0a3d8024-0ad1-4d24-8ce5-a607d0fced36 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:24.192436 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0a3d8024-0ad1-4d24-8ce5-a607d0fced36 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:24.291408 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.objects.instance [None req-0a3d8024-0ad1-4d24-8ce5-a607d0fced36 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lazy-loading 'services' on Instance uuid ccd6191d-8bbf-4ecb-803e-ca7e713501a9 {{(pid=118409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 23:10:24.366042 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6f8f1275-c5f8-447e-9cb3-1bac3260ef5e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:24.366664 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6f8f1275-c5f8-447e-9cb3-1bac3260ef5e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:24.373375 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6f8f1275-c5f8-447e-9cb3-1bac3260ef5e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:24.374153 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6f8f1275-c5f8-447e-9cb3-1bac3260ef5e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:24.374758 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6f8f1275-c5f8-447e-9cb3-1bac3260ef5e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:24.375086 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6f8f1275-c5f8-447e-9cb3-1bac3260ef5e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:24.533136 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6f8f1275-c5f8-447e-9cb3-1bac3260ef5e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:24.542597 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6f8f1275-c5f8-447e-9cb3-1bac3260ef5e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:24.544522 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6f8f1275-c5f8-447e-9cb3-1bac3260ef5e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:24.545947 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6f8f1275-c5f8-447e-9cb3-1bac3260ef5e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1672 microversion: 2.20 time: 0.184295 Jul 25 23:10:24.546487 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-0a3d8024-0ad1-4d24-8ce5-a607d0fced36 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9/os-volume_attachments/e6107bf5-d43f-476c-9209-35e9c2733ccb" status: 202 len: 0 microversion: 2.1 time: 0.369139 Jul 25 23:10:24.547181 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 380/765] 10.222.0.55 () {58 vars in 1416 bytes} [Mon Jul 25 23:10:24 2022] DELETE /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9/os-volume_attachments/e6107bf5-d43f-476c-9209-35e9c2733ccb => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 23:10:24.557544 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 386/766] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:10:24 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1672 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:10:25.572529 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-8a989d99-424e-49e1-ac5e-1123c405e3da tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:25.573375 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-8a989d99-424e-49e1-ac5e-1123c405e3da tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:25.580121 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8a989d99-424e-49e1-ac5e-1123c405e3da tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:25.580566 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8a989d99-424e-49e1-ac5e-1123c405e3da tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:25.581403 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8a989d99-424e-49e1-ac5e-1123c405e3da tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:25.581840 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8a989d99-424e-49e1-ac5e-1123c405e3da tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:25.736798 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-8a989d99-424e-49e1-ac5e-1123c405e3da tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:25.745904 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-8a989d99-424e-49e1-ac5e-1123c405e3da tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:25.747384 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-8a989d99-424e-49e1-ac5e-1123c405e3da tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:25.748548 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-8a989d99-424e-49e1-ac5e-1123c405e3da tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1730 microversion: 2.20 time: 0.181899 Jul 25 23:10:25.749103 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 381/767] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:10:25 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:10:26.776313 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-505714af-e2b3-419f-8742-3906cad81d4a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:26.776997 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-505714af-e2b3-419f-8742-3906cad81d4a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:26.784256 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-505714af-e2b3-419f-8742-3906cad81d4a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:26.784735 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-505714af-e2b3-419f-8742-3906cad81d4a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:26.785626 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-505714af-e2b3-419f-8742-3906cad81d4a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:26.786018 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-505714af-e2b3-419f-8742-3906cad81d4a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:26.811660 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-3a604dfa-02de-4135-bb54-1e110d8a2804 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:26.814444 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-3a604dfa-02de-4135-bb54-1e110d8a2804 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:26.821980 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3a604dfa-02de-4135-bb54-1e110d8a2804 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:26.822503 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3a604dfa-02de-4135-bb54-1e110d8a2804 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:26.823741 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3a604dfa-02de-4135-bb54-1e110d8a2804 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:26.824260 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3a604dfa-02de-4135-bb54-1e110d8a2804 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:26.877047 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-3a604dfa-02de-4135-bb54-1e110d8a2804 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069331 Jul 25 23:10:26.877989 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 382/768] 10.222.0.55 () {58 vars in 1302 bytes} [Mon Jul 25 23:10:26 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 23:10:26.957999 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-505714af-e2b3-419f-8742-3906cad81d4a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:26.967652 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-505714af-e2b3-419f-8742-3906cad81d4a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:26.969261 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-505714af-e2b3-419f-8742-3906cad81d4a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:26.970445 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-505714af-e2b3-419f-8742-3906cad81d4a tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1730 microversion: 2.20 time: 0.201142 Jul 25 23:10:26.975124 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 387/769] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:10:26 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1730 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:10:27.016344 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-69747a35-8b39-4002-b60e-9fb477274d4e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:27.018613 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-69747a35-8b39-4002-b60e-9fb477274d4e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:27.026365 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-69747a35-8b39-4002-b60e-9fb477274d4e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:27.026822 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-69747a35-8b39-4002-b60e-9fb477274d4e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:27.028713 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-69747a35-8b39-4002-b60e-9fb477274d4e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:27.028713 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-69747a35-8b39-4002-b60e-9fb477274d4e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:27.068587 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-69747a35-8b39-4002-b60e-9fb477274d4e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056214 Jul 25 23:10:27.069175 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 383/770] 10.222.0.55 () {58 vars in 1302 bytes} [Mon Jul 25 23:10:27 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 23:10:27.192818 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6c16b2c3-1a2e-4eed-b866-0a565dbb7e0e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:27.193348 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6c16b2c3-1a2e-4eed-b866-0a565dbb7e0e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:27.200400 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6c16b2c3-1a2e-4eed-b866-0a565dbb7e0e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:27.200850 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6c16b2c3-1a2e-4eed-b866-0a565dbb7e0e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:27.201653 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6c16b2c3-1a2e-4eed-b866-0a565dbb7e0e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:27.202429 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6c16b2c3-1a2e-4eed-b866-0a565dbb7e0e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:27.236143 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6c16b2c3-1a2e-4eed-b866-0a565dbb7e0e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Going to try to terminate instance {{(pid=118410) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 23:10:27.697285 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6c16b2c3-1a2e-4eed-b866-0a565dbb7e0e tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9" status: 204 len: 0 microversion: 2.1 time: 0.508134 Jul 25 23:10:27.697879 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 388/771] 10.222.0.55 () {58 vars in 1239 bytes} [Mon Jul 25 23:10:27 2022] DELETE /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 23:10:27.706603 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-120626d1-09ad-4594-9460-5c086d6fea62 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:27.707510 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-120626d1-09ad-4594-9460-5c086d6fea62 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:27.714363 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-120626d1-09ad-4594-9460-5c086d6fea62 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:27.715496 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-120626d1-09ad-4594-9460-5c086d6fea62 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:27.716482 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-120626d1-09ad-4594-9460-5c086d6fea62 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:27.717187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-120626d1-09ad-4594-9460-5c086d6fea62 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:27.866391 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-120626d1-09ad-4594-9460-5c086d6fea62 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:27.876302 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-120626d1-09ad-4594-9460-5c086d6fea62 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9" status: 200 len: 1674 microversion: 2.1 time: 0.174028 Jul 25 23:10:27.879427 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 384/772] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:10:27 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9 => generated 1674 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:10:28.002110 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-1f63b19a-7b39-4a32-b7d6-74898b17feab tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:28.002937 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-1f63b19a-7b39-4a32-b7d6-74898b17feab tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:28.014707 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1f63b19a-7b39-4a32-b7d6-74898b17feab tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:28.015220 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1f63b19a-7b39-4a32-b7d6-74898b17feab tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:28.020113 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1f63b19a-7b39-4a32-b7d6-74898b17feab tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:28.020113 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1f63b19a-7b39-4a32-b7d6-74898b17feab tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:28.201306 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-1f63b19a-7b39-4a32-b7d6-74898b17feab tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:28.210860 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-1f63b19a-7b39-4a32-b7d6-74898b17feab tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:28.212774 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-1f63b19a-7b39-4a32-b7d6-74898b17feab tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:28.214316 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-1f63b19a-7b39-4a32-b7d6-74898b17feab tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1730 microversion: 2.20 time: 0.217124 Jul 25 23:10:28.217170 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 389/773] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:10:27 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1730 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:10:28.901374 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-03435b0f-f5b3-4521-935b-79d0063db038 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:28.902028 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-03435b0f-f5b3-4521-935b-79d0063db038 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:28.909000 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-03435b0f-f5b3-4521-935b-79d0063db038 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:28.909745 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-03435b0f-f5b3-4521-935b-79d0063db038 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:28.910787 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-03435b0f-f5b3-4521-935b-79d0063db038 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:28.911400 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-03435b0f-f5b3-4521-935b-79d0063db038 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:29.060444 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-03435b0f-f5b3-4521-935b-79d0063db038 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:29.068154 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-03435b0f-f5b3-4521-935b-79d0063db038 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9" status: 200 len: 1674 microversion: 2.1 time: 0.172971 Jul 25 23:10:29.068921 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 385/774] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:10:28 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9 => generated 1674 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:10:29.242922 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-ab859b7f-0077-4182-8f5b-e2311550d96c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:29.242922 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-ab859b7f-0077-4182-8f5b-e2311550d96c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:29.249764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ab859b7f-0077-4182-8f5b-e2311550d96c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:29.250586 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ab859b7f-0077-4182-8f5b-e2311550d96c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:29.251639 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ab859b7f-0077-4182-8f5b-e2311550d96c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:29.252295 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ab859b7f-0077-4182-8f5b-e2311550d96c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:29.419731 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ab859b7f-0077-4182-8f5b-e2311550d96c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:29.429076 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ab859b7f-0077-4182-8f5b-e2311550d96c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:29.431778 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ab859b7f-0077-4182-8f5b-e2311550d96c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:29.433223 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-ab859b7f-0077-4182-8f5b-e2311550d96c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1730 microversion: 2.20 time: 0.198527 Jul 25 23:10:29.433883 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 390/775] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:10:29 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1730 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:10:30.090811 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-f384e207-134c-4c6a-99f6-6785d60879de tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:30.092405 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-f384e207-134c-4c6a-99f6-6785d60879de tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:30.103390 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f384e207-134c-4c6a-99f6-6785d60879de tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:30.103900 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f384e207-134c-4c6a-99f6-6785d60879de tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:30.104824 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f384e207-134c-4c6a-99f6-6785d60879de tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:30.105437 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f384e207-134c-4c6a-99f6-6785d60879de tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:30.330606 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-f384e207-134c-4c6a-99f6-6785d60879de tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:30.344204 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-f384e207-134c-4c6a-99f6-6785d60879de tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9" status: 200 len: 1674 microversion: 2.1 time: 0.257289 Jul 25 23:10:30.344797 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 386/776] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:10:30 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9 => generated 1674 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:10:30.458817 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f5f123c7-fd1c-4c49-b510-7f94913e80bc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:30.460017 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f5f123c7-fd1c-4c49-b510-7f94913e80bc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:30.490457 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f5f123c7-fd1c-4c49-b510-7f94913e80bc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:30.491202 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f5f123c7-fd1c-4c49-b510-7f94913e80bc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:30.492873 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f5f123c7-fd1c-4c49-b510-7f94913e80bc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:30.493525 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f5f123c7-fd1c-4c49-b510-7f94913e80bc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:30.660280 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f5f123c7-fd1c-4c49-b510-7f94913e80bc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:30.673740 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f5f123c7-fd1c-4c49-b510-7f94913e80bc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:30.675762 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f5f123c7-fd1c-4c49-b510-7f94913e80bc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:30.677490 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f5f123c7-fd1c-4c49-b510-7f94913e80bc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1730 microversion: 2.20 time: 0.224026 Jul 25 23:10:30.678258 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 391/777] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:10:30 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1730 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:10:31.366728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-bc0e7939-f5c0-4412-8f40-d7ae46ce91b7 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:31.368342 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-bc0e7939-f5c0-4412-8f40-d7ae46ce91b7 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:31.375743 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-bc0e7939-f5c0-4412-8f40-d7ae46ce91b7 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:31.376619 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-bc0e7939-f5c0-4412-8f40-d7ae46ce91b7 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:31.377682 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-bc0e7939-f5c0-4412-8f40-d7ae46ce91b7 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:31.378274 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-bc0e7939-f5c0-4412-8f40-d7ae46ce91b7 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:31.535092 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-bc0e7939-f5c0-4412-8f40-d7ae46ce91b7 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:31.545867 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-bc0e7939-f5c0-4412-8f40-d7ae46ce91b7 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9" status: 200 len: 1674 microversion: 2.1 time: 0.183314 Jul 25 23:10:31.555392 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 387/778] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:10:31 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9 => generated 1674 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:10:31.705520 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-80c5857d-9f61-45dc-86c6-b2bc9ac67dbd tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:31.706209 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-80c5857d-9f61-45dc-86c6-b2bc9ac67dbd tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:31.716091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-80c5857d-9f61-45dc-86c6-b2bc9ac67dbd tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:31.716951 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-80c5857d-9f61-45dc-86c6-b2bc9ac67dbd tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:31.718324 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-80c5857d-9f61-45dc-86c6-b2bc9ac67dbd tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:31.718985 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-80c5857d-9f61-45dc-86c6-b2bc9ac67dbd tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:31.909706 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-80c5857d-9f61-45dc-86c6-b2bc9ac67dbd tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:31.935725 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-80c5857d-9f61-45dc-86c6-b2bc9ac67dbd tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:31.937289 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-80c5857d-9f61-45dc-86c6-b2bc9ac67dbd tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:31.938443 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-80c5857d-9f61-45dc-86c6-b2bc9ac67dbd tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1730 microversion: 2.20 time: 0.239594 Jul 25 23:10:31.939006 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 392/779] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:10:31 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1730 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:10:32.578528 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-aeeea39c-147b-46ba-91e3-9f06225a9a49 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:32.579767 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-aeeea39c-147b-46ba-91e3-9f06225a9a49 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:32.588580 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-aeeea39c-147b-46ba-91e3-9f06225a9a49 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:32.589383 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-aeeea39c-147b-46ba-91e3-9f06225a9a49 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:32.590238 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-aeeea39c-147b-46ba-91e3-9f06225a9a49 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:32.590890 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-aeeea39c-147b-46ba-91e3-9f06225a9a49 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:32.595551 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:32.745846 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-aeeea39c-147b-46ba-91e3-9f06225a9a49 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:32.753541 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-aeeea39c-147b-46ba-91e3-9f06225a9a49 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9" status: 200 len: 1674 microversion: 2.1 time: 0.178808 Jul 25 23:10:32.754120 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 388/780] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:10:32 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9 => generated 1674 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:10:32.964569 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-22e6e30d-f0a4-4782-9b7c-76a27ecffb26 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:32.966144 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-22e6e30d-f0a4-4782-9b7c-76a27ecffb26 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:32.974245 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-22e6e30d-f0a4-4782-9b7c-76a27ecffb26 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:32.975035 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-22e6e30d-f0a4-4782-9b7c-76a27ecffb26 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:32.976273 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-22e6e30d-f0a4-4782-9b7c-76a27ecffb26 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:32.977385 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-22e6e30d-f0a4-4782-9b7c-76a27ecffb26 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:33.126518 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-22e6e30d-f0a4-4782-9b7c-76a27ecffb26 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:33.135556 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-22e6e30d-f0a4-4782-9b7c-76a27ecffb26 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:33.137062 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-22e6e30d-f0a4-4782-9b7c-76a27ecffb26 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:33.138269 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-22e6e30d-f0a4-4782-9b7c-76a27ecffb26 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1730 microversion: 2.20 time: 0.179390 Jul 25 23:10:33.138858 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 393/781] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:10:32 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:10:33.776124 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-504a828b-18e3-482b-ad79-0c4cf6d939da tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:33.776688 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-504a828b-18e3-482b-ad79-0c4cf6d939da tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:33.783308 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-504a828b-18e3-482b-ad79-0c4cf6d939da tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:33.783746 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-504a828b-18e3-482b-ad79-0c4cf6d939da tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:33.784492 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-504a828b-18e3-482b-ad79-0c4cf6d939da tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:33.784957 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-504a828b-18e3-482b-ad79-0c4cf6d939da tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:33.944441 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-504a828b-18e3-482b-ad79-0c4cf6d939da tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:33.952998 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-504a828b-18e3-482b-ad79-0c4cf6d939da tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9" status: 200 len: 1674 microversion: 2.1 time: 0.181322 Jul 25 23:10:33.959226 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 389/782] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:10:33 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9 => generated 1674 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:10:34.162875 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-84b33c74-ff5e-4357-a945-1ee501604595 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:34.164255 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-84b33c74-ff5e-4357-a945-1ee501604595 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:34.171501 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-84b33c74-ff5e-4357-a945-1ee501604595 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:34.171952 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-84b33c74-ff5e-4357-a945-1ee501604595 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:34.172924 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-84b33c74-ff5e-4357-a945-1ee501604595 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:34.173646 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-84b33c74-ff5e-4357-a945-1ee501604595 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:34.331995 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-84b33c74-ff5e-4357-a945-1ee501604595 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:34.342149 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-84b33c74-ff5e-4357-a945-1ee501604595 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:34.343851 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-84b33c74-ff5e-4357-a945-1ee501604595 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:34.345268 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-84b33c74-ff5e-4357-a945-1ee501604595 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1730 microversion: 2.20 time: 0.186349 Jul 25 23:10:34.345921 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 394/783] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:10:34 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:10:34.979507 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-7df72829-06a5-421d-ae62-a04d1b548f72 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:34.980124 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-7df72829-06a5-421d-ae62-a04d1b548f72 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:34.987297 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7df72829-06a5-421d-ae62-a04d1b548f72 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:34.987780 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7df72829-06a5-421d-ae62-a04d1b548f72 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:34.988609 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7df72829-06a5-421d-ae62-a04d1b548f72 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:34.989130 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7df72829-06a5-421d-ae62-a04d1b548f72 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:35.122018 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-7df72829-06a5-421d-ae62-a04d1b548f72 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:35.131212 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-7df72829-06a5-421d-ae62-a04d1b548f72 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9" status: 200 len: 1674 microversion: 2.1 time: 0.156333 Jul 25 23:10:35.131990 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 390/784] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:10:34 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:10:35.369315 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-1ae17028-5fd6-4b71-b3ec-536463b12ed8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:35.369987 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-1ae17028-5fd6-4b71-b3ec-536463b12ed8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:35.376436 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1ae17028-5fd6-4b71-b3ec-536463b12ed8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:35.377747 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1ae17028-5fd6-4b71-b3ec-536463b12ed8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:35.377747 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1ae17028-5fd6-4b71-b3ec-536463b12ed8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:35.378118 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1ae17028-5fd6-4b71-b3ec-536463b12ed8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:35.515723 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-1ae17028-5fd6-4b71-b3ec-536463b12ed8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:35.524875 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-1ae17028-5fd6-4b71-b3ec-536463b12ed8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:35.526412 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-1ae17028-5fd6-4b71-b3ec-536463b12ed8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:35.527593 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-1ae17028-5fd6-4b71-b3ec-536463b12ed8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1730 microversion: 2.20 time: 0.162298 Jul 25 23:10:35.528158 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 395/785] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:10:35 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:10:36.157628 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-bd5f33fe-11e2-49fd-a6c0-0bce09fecb43 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:36.158223 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-bd5f33fe-11e2-49fd-a6c0-0bce09fecb43 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:36.160539 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_api:SELECT=50 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:36.166167 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-bd5f33fe-11e2-49fd-a6c0-0bce09fecb43 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:36.166629 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-bd5f33fe-11e2-49fd-a6c0-0bce09fecb43 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:36.167361 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-bd5f33fe-11e2-49fd-a6c0-0bce09fecb43 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:36.167783 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-bd5f33fe-11e2-49fd-a6c0-0bce09fecb43 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:36.307287 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-bd5f33fe-11e2-49fd-a6c0-0bce09fecb43 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:36.315067 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-bd5f33fe-11e2-49fd-a6c0-0bce09fecb43 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9" status: 200 len: 1674 microversion: 2.1 time: 0.161296 Jul 25 23:10:36.315635 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 391/786] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:10:36 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:10:36.551516 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e88e8224-99b4-4e1e-af96-e8f6c06dfc3d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:36.552168 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e88e8224-99b4-4e1e-af96-e8f6c06dfc3d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:36.558978 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e88e8224-99b4-4e1e-af96-e8f6c06dfc3d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:36.559450 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e88e8224-99b4-4e1e-af96-e8f6c06dfc3d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:36.560208 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e88e8224-99b4-4e1e-af96-e8f6c06dfc3d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:36.560644 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e88e8224-99b4-4e1e-af96-e8f6c06dfc3d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:36.700332 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e88e8224-99b4-4e1e-af96-e8f6c06dfc3d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:36.709305 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e88e8224-99b4-4e1e-af96-e8f6c06dfc3d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:36.711473 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e88e8224-99b4-4e1e-af96-e8f6c06dfc3d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:36.712795 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e88e8224-99b4-4e1e-af96-e8f6c06dfc3d tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1730 microversion: 2.20 time: 0.165185 Jul 25 23:10:36.713584 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 396/787] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:10:36 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:10:37.337440 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-dd260253-c763-464e-9e99-d910ccf5628d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:37.340569 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-dd260253-c763-464e-9e99-d910ccf5628d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:37.345156 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-dd260253-c763-464e-9e99-d910ccf5628d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:37.345567 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-dd260253-c763-464e-9e99-d910ccf5628d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:37.346351 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-dd260253-c763-464e-9e99-d910ccf5628d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:37.346782 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-dd260253-c763-464e-9e99-d910ccf5628d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:37.506198 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-dd260253-c763-464e-9e99-d910ccf5628d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:37.514856 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-dd260253-c763-464e-9e99-d910ccf5628d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9" status: 200 len: 1674 microversion: 2.1 time: 0.181350 Jul 25 23:10:37.515440 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 392/788] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:10:37 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9 => generated 1674 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:10:37.739278 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-dd785124-d496-440e-9f9c-c8328b229c96 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:37.739838 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-dd785124-d496-440e-9f9c-c8328b229c96 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:37.742547 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:37.747818 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dd785124-d496-440e-9f9c-c8328b229c96 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:37.748251 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dd785124-d496-440e-9f9c-c8328b229c96 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:37.749012 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dd785124-d496-440e-9f9c-c8328b229c96 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:37.749473 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dd785124-d496-440e-9f9c-c8328b229c96 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:37.894585 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-dd785124-d496-440e-9f9c-c8328b229c96 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:37.905501 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-dd785124-d496-440e-9f9c-c8328b229c96 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:37.907280 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-dd785124-d496-440e-9f9c-c8328b229c96 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:37.908666 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-dd785124-d496-440e-9f9c-c8328b229c96 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1730 microversion: 2.20 time: 0.173436 Jul 25 23:10:37.909904 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 397/789] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:10:37 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:10:38.537481 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-b238b080-3d00-4171-b33e-6c72e4dbedc4 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:38.538227 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-b238b080-3d00-4171-b33e-6c72e4dbedc4 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:38.545233 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b238b080-3d00-4171-b33e-6c72e4dbedc4 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:38.545906 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b238b080-3d00-4171-b33e-6c72e4dbedc4 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:38.546695 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b238b080-3d00-4171-b33e-6c72e4dbedc4 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:38.547133 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b238b080-3d00-4171-b33e-6c72e4dbedc4 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:38.687827 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-b238b080-3d00-4171-b33e-6c72e4dbedc4 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:38.696028 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-b238b080-3d00-4171-b33e-6c72e4dbedc4 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9" status: 200 len: 1674 microversion: 2.1 time: 0.162441 Jul 25 23:10:38.696608 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 393/790] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:10:38 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:10:38.935291 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-33a191df-cd14-4b46-a7bb-83ff3ce3f2cb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:38.936808 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-33a191df-cd14-4b46-a7bb-83ff3ce3f2cb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:38.938485 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-6e6e8d5b-85eb-4b7c-8822-351277f07c47 req-351249f5-9a49-4dc1-b139-fafd4343842b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ccd6191d-8bbf-4ecb-803e-ca7e713501a9", "name": "network-vif-deleted", "tag": "def0df55-c041-43a7-b482-7705b29f55d9"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:10:38.943472 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-33a191df-cd14-4b46-a7bb-83ff3ce3f2cb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:38.943916 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-33a191df-cd14-4b46-a7bb-83ff3ce3f2cb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:38.945000 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-33a191df-cd14-4b46-a7bb-83ff3ce3f2cb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:38.945682 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-33a191df-cd14-4b46-a7bb-83ff3ce3f2cb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:38.956589 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-6e6e8d5b-85eb-4b7c-8822-351277f07c47 req-351249f5-9a49-4dc1-b139-fafd4343842b service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:38.957386 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-6e6e8d5b-85eb-4b7c-8822-351277f07c47 req-351249f5-9a49-4dc1-b139-fafd4343842b service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:38.970119 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-6e6e8d5b-85eb-4b7c-8822-351277f07c47 req-351249f5-9a49-4dc1-b139-fafd4343842b service nova] Creating event network-vif-deleted:def0df55-c041-43a7-b482-7705b29f55d9 for instance ccd6191d-8bbf-4ecb-803e-ca7e713501a9 on hv-cinder-79760 Jul 25 23:10:38.977712 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-6e6e8d5b-85eb-4b7c-8822-351277f07c47 req-351249f5-9a49-4dc1-b139-fafd4343842b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041371 Jul 25 23:10:38.979618 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 394/791] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:10:39.112819 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-33a191df-cd14-4b46-a7bb-83ff3ce3f2cb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:39.122557 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-33a191df-cd14-4b46-a7bb-83ff3ce3f2cb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:39.124087 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-33a191df-cd14-4b46-a7bb-83ff3ce3f2cb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:39.125370 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-33a191df-cd14-4b46-a7bb-83ff3ce3f2cb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1730 microversion: 2.20 time: 0.195249 Jul 25 23:10:39.125934 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 398/792] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:10:38 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1730 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:10:39.718184 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-54c92f93-b314-4ff6-8dd3-300398998ac1 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:39.718974 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-54c92f93-b314-4ff6-8dd3-300398998ac1 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:39.727525 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-54c92f93-b314-4ff6-8dd3-300398998ac1 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:39.732270 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-54c92f93-b314-4ff6-8dd3-300398998ac1 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:39.732270 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-54c92f93-b314-4ff6-8dd3-300398998ac1 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:39.732270 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-54c92f93-b314-4ff6-8dd3-300398998ac1 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:39.765912 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-54c92f93-b314-4ff6-8dd3-300398998ac1 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:39.766367 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-54c92f93-b314-4ff6-8dd3-300398998ac1 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:39.766818 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.objects.instance [None req-54c92f93-b314-4ff6-8dd3-300398998ac1 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lazy-loading 'fault' on Instance uuid ccd6191d-8bbf-4ecb-803e-ca7e713501a9 {{(pid=118409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 23:10:39.815728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-54c92f93-b314-4ff6-8dd3-300398998ac1 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eea5a29c87d431299b220e404fd5732', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0c3fc0630dd4083bcc8a9f70af99463', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:39.823799 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-54c92f93-b314-4ff6-8dd3-300398998ac1 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9" status: 200 len: 1327 microversion: 2.1 time: 0.110247 Jul 25 23:10:39.824399 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 395/793] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:10:39 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9 => generated 1327 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:10:40.124629 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-46918844-7258-4dee-8a09-b251b1e2c6c2 req-b53af63d-cd8e-48f0-9ac9-7726ee993db8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5f69472-1864-4211-b288-44e579367954", "name": "network-vif-plugged", "status": "completed", "tag": "c6685a7a-bff1-4d27-8daf-0e1614096b58"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:10:40.137417 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-46918844-7258-4dee-8a09-b251b1e2c6c2 req-b53af63d-cd8e-48f0-9ac9-7726ee993db8 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:40.137872 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-46918844-7258-4dee-8a09-b251b1e2c6c2 req-b53af63d-cd8e-48f0-9ac9-7726ee993db8 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:40.150078 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-46918844-7258-4dee-8a09-b251b1e2c6c2 req-b53af63d-cd8e-48f0-9ac9-7726ee993db8 service nova] Creating event network-vif-plugged:c6685a7a-bff1-4d27-8daf-0e1614096b58 for instance c5f69472-1864-4211-b288-44e579367954 on hv-cinder-79760 Jul 25 23:10:40.155519 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-46918844-7258-4dee-8a09-b251b1e2c6c2 req-b53af63d-cd8e-48f0-9ac9-7726ee993db8 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035007 Jul 25 23:10:40.156131 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 399/794] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 23:10:40.158604 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-9e4bfcaf-2781-4853-b2e7-d68c33502347 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:40.159203 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-9e4bfcaf-2781-4853-b2e7-d68c33502347 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:40.165849 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9e4bfcaf-2781-4853-b2e7-d68c33502347 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:40.167770 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9e4bfcaf-2781-4853-b2e7-d68c33502347 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:40.167770 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9e4bfcaf-2781-4853-b2e7-d68c33502347 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:40.167770 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9e4bfcaf-2781-4853-b2e7-d68c33502347 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:40.327255 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-9e4bfcaf-2781-4853-b2e7-d68c33502347 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:40.337497 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-9e4bfcaf-2781-4853-b2e7-d68c33502347 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:40.338972 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-9e4bfcaf-2781-4853-b2e7-d68c33502347 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:40.340205 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-9e4bfcaf-2781-4853-b2e7-d68c33502347 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1730 microversion: 2.20 time: 0.185724 Jul 25 23:10:40.340768 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 396/795] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:10:40 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 25 23:10:40.846445 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-fa5f655d-fd03-4056-9178-9b3ce0a2b8f5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:40.847273 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-fa5f655d-fd03-4056-9178-9b3ce0a2b8f5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:40.854299 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fa5f655d-fd03-4056-9178-9b3ce0a2b8f5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:40.854746 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fa5f655d-fd03-4056-9178-9b3ce0a2b8f5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:40.855525 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fa5f655d-fd03-4056-9178-9b3ce0a2b8f5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:40.855993 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fa5f655d-fd03-4056-9178-9b3ce0a2b8f5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:40.871286 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-fa5f655d-fd03-4056-9178-9b3ce0a2b8f5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] HTTP exception thrown: Instance ccd6191d-8bbf-4ecb-803e-ca7e713501a9 could not be found. Jul 25 23:10:40.872927 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-fa5f655d-fd03-4056-9178-9b3ce0a2b8f5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Request method failure captured: Jul 25 23:10:40.872927 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9 HTTP/1.1 Jul 25 23:10:40.872927 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 25 23:10:40.872927 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 25 23:10:40.872927 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Connection: close Jul 25 23:10:40.872927 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 25 23:10:40.872927 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 25 23:10:40.872927 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Host: 10.222.0.55 Jul 25 23:10:40.872927 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 25 23:10:40.872927 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.10 Jul 25 23:10:40.872927 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABi3yFo_tIojYVjGSyPNnsCOmVzSmhsMzU-aCps7S4Bg5YP14BzxTujy_Jw32T068wClp37u14xG0eRRAX-sOTSEox01hQPRKMnkl3sGuiXygMuZk_hwxD2nQAIdMbgyaG15J7NMphgvWwnthNIMAa88y8cvgOT1LG8zlva6Nrg9296ZxM Jul 25 23:10:40.872927 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 25 23:10:40.872927 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 25 23:10:40.872927 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 25 23:10:40.872927 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 25 23:10:40.872927 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 25 23:10:40.872927 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 25 23:10:40.872927 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Id: f0c3fc0630dd4083bcc8a9f70af99463 Jul 25 23:10:40.872927 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-AttachVolumeTestJSON-677038220 Jul 25 23:10:40.872927 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Role: reader,member Jul 25 23:10:40.872927 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Roles: reader,member Jul 25 23:10:40.874542 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f0c3fc0630dd4083bcc8a9f70af99463"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f0c3fc0630dd4083bcc8a9f70af99463"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f0c3fc0630dd4083bcc8a9f70af99463", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f0c3fc0630dd4083bcc8a9f70af99463"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:10:40.874542 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-AttachVolumeTestJSON-677038220 Jul 25 23:10:40.874542 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Id: f0c3fc0630dd4083bcc8a9f70af99463 Jul 25 23:10:40.874542 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-AttachVolumeTestJSON-677038220 Jul 25 23:10:40.874542 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User: tempest-AttachVolumeTestJSON-677038220-project Jul 25 23:10:40.874542 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 25 23:10:40.874542 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 25 23:10:40.874542 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Id: 4eea5a29c87d431299b220e404fd5732 Jul 25 23:10:40.874542 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-AttachVolumeTestJSON-677038220-project Jul 25 23:10:40.874542 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: method: > Jul 25 23:10:40.874542 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: exception: Instance ccd6191d-8bbf-4ecb-803e-ca7e713501a9 could not be found. Jul 25 23:10:40.874542 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: action_args: {'id': 'ccd6191d-8bbf-4ecb-803e-ca7e713501a9'} Jul 25 23:10:40.875375 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:10:40.875375 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:10:40.875375 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:10:40.875375 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:10:40.875375 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:10:40.875375 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:10:40.875375 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:10:40.875375 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:10:40.875375 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:10:40.875375 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:10:40.875375 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccd6191d-8bbf-4ecb-803e-ca7e713501a9 could not be found. Jul 25 23:10:40.875375 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:10:40.875375 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:10:40.875375 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:10:40.875375 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:10:40.875375 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:10:40.875375 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:10:40.875375 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:10:40.875375 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:10:40.875375 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:10:40.876885 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:10:40.876885 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 23:10:40.876885 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 23:10:40.876885 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:10:40.876885 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:10:40.876885 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:10:40.876885 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:10:40.876885 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccd6191d-8bbf-4ecb-803e-ca7e713501a9 could not be found. Jul 25 23:10:40.876885 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:10:40.876885 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:10:40.876885 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:10:40.876885 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:10:40.876885 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:10:40.876885 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:10:40.876885 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:10:40.876885 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:10:40.876885 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccd6191d-8bbf-4ecb-803e-ca7e713501a9 could not be found. Jul 25 23:10:40.876885 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:10:40.878298 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-fa5f655d-fd03-4056-9178-9b3ce0a2b8f5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Returning 404 to user: Instance ccd6191d-8bbf-4ecb-803e-ca7e713501a9 could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:10:40.878298 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-fa5f655d-fd03-4056-9178-9b3ce0a2b8f5 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9" status: 404 len: 111 microversion: 2.1 time: 0.032373 Jul 25 23:10:40.878298 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 400/796] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:10:40 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:10:40.885357 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-f2590bda-4fcc-4283-805f-4dff5395a728 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '.version_select at 0x7f622f813a60>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:41.223207 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-f2590bda-4fcc-4283-805f-4dff5395a728 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1690200607" status: 202 len: 0 microversion: 2.1 time: 0.342915 Jul 25 23:10:41.225719 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 397/797] 10.222.0.55 () {58 vars in 1221 bytes} [Mon Jul 25 23:10:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1690200607 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 23:10:41.363828 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4f3ae47a-afd2-4089-9e19-14ba794c9c11 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:41.364431 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4f3ae47a-afd2-4089-9e19-14ba794c9c11 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:41.371652 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4f3ae47a-afd2-4089-9e19-14ba794c9c11 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:41.372104 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4f3ae47a-afd2-4089-9e19-14ba794c9c11 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:41.372873 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4f3ae47a-afd2-4089-9e19-14ba794c9c11 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:41.373334 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4f3ae47a-afd2-4089-9e19-14ba794c9c11 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:41.641897 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4f3ae47a-afd2-4089-9e19-14ba794c9c11 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:41.645876 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:10:41.651555 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4f3ae47a-afd2-4089-9e19-14ba794c9c11 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:41.653049 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4f3ae47a-afd2-4089-9e19-14ba794c9c11 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:41.654465 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4f3ae47a-afd2-4089-9e19-14ba794c9c11 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1730 microversion: 2.20 time: 0.294700 Jul 25 23:10:41.655012 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 401/798] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:10:41 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1730 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:10:42.680998 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-e0c82c8c-3777-4bcc-ad13-8a549aaf9a8f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:42.682287 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-e0c82c8c-3777-4bcc-ad13-8a549aaf9a8f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:42.691274 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e0c82c8c-3777-4bcc-ad13-8a549aaf9a8f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:42.691968 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e0c82c8c-3777-4bcc-ad13-8a549aaf9a8f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:42.692912 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e0c82c8c-3777-4bcc-ad13-8a549aaf9a8f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:42.693499 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e0c82c8c-3777-4bcc-ad13-8a549aaf9a8f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:42.844616 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-e0c82c8c-3777-4bcc-ad13-8a549aaf9a8f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:42.853511 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-e0c82c8c-3777-4bcc-ad13-8a549aaf9a8f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:42.855095 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-e0c82c8c-3777-4bcc-ad13-8a549aaf9a8f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:42.856333 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-e0c82c8c-3777-4bcc-ad13-8a549aaf9a8f tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1730 microversion: 2.20 time: 0.181040 Jul 25 23:10:42.857153 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 398/799] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:10:42 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:10:43.879325 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e9ac353f-f5a0-459e-a671-1f8b40c806fb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:43.880032 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e9ac353f-f5a0-459e-a671-1f8b40c806fb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:43.888907 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e9ac353f-f5a0-459e-a671-1f8b40c806fb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:43.889377 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e9ac353f-f5a0-459e-a671-1f8b40c806fb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:43.890201 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e9ac353f-f5a0-459e-a671-1f8b40c806fb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:43.890631 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e9ac353f-f5a0-459e-a671-1f8b40c806fb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:44.028705 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e9ac353f-f5a0-459e-a671-1f8b40c806fb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:44.036502 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e9ac353f-f5a0-459e-a671-1f8b40c806fb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:44.038025 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e9ac353f-f5a0-459e-a671-1f8b40c806fb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:44.039664 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e9ac353f-f5a0-459e-a671-1f8b40c806fb tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1730 microversion: 2.20 time: 0.164418 Jul 25 23:10:44.040591 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 402/800] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:10:43 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:10:44.568099 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-b7e51335-45c8-42cf-b2a8-cfe94368ade9 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:44.568611 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-b7e51335-45c8-42cf-b2a8-cfe94368ade9 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:44.575098 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b7e51335-45c8-42cf-b2a8-cfe94368ade9 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:44.575535 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b7e51335-45c8-42cf-b2a8-cfe94368ade9 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:44.576318 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b7e51335-45c8-42cf-b2a8-cfe94368ade9 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:44.576741 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b7e51335-45c8-42cf-b2a8-cfe94368ade9 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:44.590785 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.wsgi [None req-b7e51335-45c8-42cf-b2a8-cfe94368ade9 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] HTTP exception thrown: Instance ccd6191d-8bbf-4ecb-803e-ca7e713501a9 could not be found. Jul 25 23:10:44.592455 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-b7e51335-45c8-42cf-b2a8-cfe94368ade9 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Request method failure captured: Jul 25 23:10:44.592455 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: request: DELETE /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9 HTTP/1.1 Jul 25 23:10:44.592455 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept: application/json Jul 25 23:10:44.592455 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept-Encoding: identity Jul 25 23:10:44.592455 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Connection: close Jul 25 23:10:44.592455 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Length: 0 Jul 25 23:10:44.592455 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Type: application/json Jul 25 23:10:44.592455 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Host: 10.222.0.55 Jul 25 23:10:44.592455 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Openstack-System-Scope: None Jul 25 23:10:44.592455 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: User-Agent: python-urllib3/1.26.10 Jul 25 23:10:44.592455 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Auth-Token: gAAAAABi3yFo_tIojYVjGSyPNnsCOmVzSmhsMzU-aCps7S4Bg5YP14BzxTujy_Jw32T068wClp37u14xG0eRRAX-sOTSEox01hQPRKMnkl3sGuiXygMuZk_hwxD2nQAIdMbgyaG15J7NMphgvWwnthNIMAa88y8cvgOT1LG8zlva6Nrg9296ZxM Jul 25 23:10:44.592455 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Id: None Jul 25 23:10:44.592455 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Name: None Jul 25 23:10:44.592455 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Identity-Status: Confirmed Jul 25 23:10:44.592455 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Is-Admin-Project: True Jul 25 23:10:44.592455 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Id: default Jul 25 23:10:44.592455 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Name: Default Jul 25 23:10:44.592455 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Id: f0c3fc0630dd4083bcc8a9f70af99463 Jul 25 23:10:44.592455 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Name: tempest-AttachVolumeTestJSON-677038220 Jul 25 23:10:44.592455 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Role: reader,member Jul 25 23:10:44.592455 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Roles: reader,member Jul 25 23:10:44.594026 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f0c3fc0630dd4083bcc8a9f70af99463"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f0c3fc0630dd4083bcc8a9f70af99463"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f0c3fc0630dd4083bcc8a9f70af99463", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f0c3fc0630dd4083bcc8a9f70af99463"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:10:44.594026 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant: tempest-AttachVolumeTestJSON-677038220 Jul 25 23:10:44.594026 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Id: f0c3fc0630dd4083bcc8a9f70af99463 Jul 25 23:10:44.594026 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Name: tempest-AttachVolumeTestJSON-677038220 Jul 25 23:10:44.594026 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User: tempest-AttachVolumeTestJSON-677038220-project Jul 25 23:10:44.594026 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Id: default Jul 25 23:10:44.594026 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Name: Default Jul 25 23:10:44.594026 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Id: 4eea5a29c87d431299b220e404fd5732 Jul 25 23:10:44.594026 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Name: tempest-AttachVolumeTestJSON-677038220-project Jul 25 23:10:44.594026 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: method: > Jul 25 23:10:44.594026 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: exception: Instance ccd6191d-8bbf-4ecb-803e-ca7e713501a9 could not be found. Jul 25 23:10:44.594026 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: action_args: {'id': 'ccd6191d-8bbf-4ecb-803e-ca7e713501a9'} Jul 25 23:10:44.594958 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:10:44.594958 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:10:44.594958 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:10:44.594958 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:10:44.594958 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:10:44.594958 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:10:44.594958 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:10:44.594958 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:10:44.594958 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:10:44.594958 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:10:44.594958 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccd6191d-8bbf-4ecb-803e-ca7e713501a9 could not be found. Jul 25 23:10:44.594958 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:10:44.594958 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:10:44.594958 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:10:44.594958 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:10:44.594958 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:10:44.594958 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:10:44.594958 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:10:44.594958 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:10:44.594958 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:10:44.596470 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:10:44.596470 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 23:10:44.596470 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 23:10:44.596470 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 23:10:44.596470 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 23:10:44.596470 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:10:44.596470 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:10:44.596470 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:10:44.596470 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:10:44.596470 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccd6191d-8bbf-4ecb-803e-ca7e713501a9 could not be found. Jul 25 23:10:44.596470 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:10:44.596470 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:10:44.596470 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:10:44.596470 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:10:44.596470 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:10:44.596470 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:10:44.596470 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:10:44.596470 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:10:44.596470 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccd6191d-8bbf-4ecb-803e-ca7e713501a9 could not be found. Jul 25 23:10:44.596470 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:10:44.598174 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-b7e51335-45c8-42cf-b2a8-cfe94368ade9 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Returning 404 to user: Instance ccd6191d-8bbf-4ecb-803e-ca7e713501a9 could not be found. {{(pid=118409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:10:44.598174 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-b7e51335-45c8-42cf-b2a8-cfe94368ade9 tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "DELETE /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9" status: 404 len: 111 microversion: 2.1 time: 0.029609 Jul 25 23:10:44.598174 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 399/801] 10.222.0.55 () {58 vars in 1239 bytes} [Mon Jul 25 23:10:44 2022] DELETE /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:10:44.602778 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-9c527a87-0b0a-4868-8b75-3d8c7ae4825f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:44.603370 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-9c527a87-0b0a-4868-8b75-3d8c7ae4825f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: ccd6191d-8bbf-4ecb-803e-ca7e713501a9] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:44.609900 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9c527a87-0b0a-4868-8b75-3d8c7ae4825f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:44.610342 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9c527a87-0b0a-4868-8b75-3d8c7ae4825f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:44.611112 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9c527a87-0b0a-4868-8b75-3d8c7ae4825f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:44.611574 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9c527a87-0b0a-4868-8b75-3d8c7ae4825f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:44.625259 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-9c527a87-0b0a-4868-8b75-3d8c7ae4825f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] HTTP exception thrown: Instance ccd6191d-8bbf-4ecb-803e-ca7e713501a9 could not be found. Jul 25 23:10:44.626802 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-9c527a87-0b0a-4868-8b75-3d8c7ae4825f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Request method failure captured: Jul 25 23:10:44.626802 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9 HTTP/1.1 Jul 25 23:10:44.626802 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 25 23:10:44.626802 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 25 23:10:44.626802 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Connection: close Jul 25 23:10:44.626802 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 25 23:10:44.626802 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 25 23:10:44.626802 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Host: 10.222.0.55 Jul 25 23:10:44.626802 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 25 23:10:44.626802 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.10 Jul 25 23:10:44.626802 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABi3yFo_tIojYVjGSyPNnsCOmVzSmhsMzU-aCps7S4Bg5YP14BzxTujy_Jw32T068wClp37u14xG0eRRAX-sOTSEox01hQPRKMnkl3sGuiXygMuZk_hwxD2nQAIdMbgyaG15J7NMphgvWwnthNIMAa88y8cvgOT1LG8zlva6Nrg9296ZxM Jul 25 23:10:44.626802 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 25 23:10:44.626802 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 25 23:10:44.626802 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 25 23:10:44.626802 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 25 23:10:44.626802 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 25 23:10:44.626802 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 25 23:10:44.626802 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Id: f0c3fc0630dd4083bcc8a9f70af99463 Jul 25 23:10:44.626802 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-AttachVolumeTestJSON-677038220 Jul 25 23:10:44.626802 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Role: reader,member Jul 25 23:10:44.626802 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Roles: reader,member Jul 25 23:10:44.628368 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f0c3fc0630dd4083bcc8a9f70af99463"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f0c3fc0630dd4083bcc8a9f70af99463"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f0c3fc0630dd4083bcc8a9f70af99463", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f0c3fc0630dd4083bcc8a9f70af99463"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:10:44.628368 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-AttachVolumeTestJSON-677038220 Jul 25 23:10:44.628368 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Id: f0c3fc0630dd4083bcc8a9f70af99463 Jul 25 23:10:44.628368 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-AttachVolumeTestJSON-677038220 Jul 25 23:10:44.628368 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User: tempest-AttachVolumeTestJSON-677038220-project Jul 25 23:10:44.628368 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 25 23:10:44.628368 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 25 23:10:44.628368 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Id: 4eea5a29c87d431299b220e404fd5732 Jul 25 23:10:44.628368 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-AttachVolumeTestJSON-677038220-project Jul 25 23:10:44.628368 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: method: > Jul 25 23:10:44.628368 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: exception: Instance ccd6191d-8bbf-4ecb-803e-ca7e713501a9 could not be found. Jul 25 23:10:44.628368 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: action_args: {'id': 'ccd6191d-8bbf-4ecb-803e-ca7e713501a9'} Jul 25 23:10:44.629342 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:10:44.629342 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:10:44.629342 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:10:44.629342 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:10:44.629342 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:10:44.629342 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:10:44.629342 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:10:44.629342 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:10:44.629342 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:10:44.629342 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:10:44.629342 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ccd6191d-8bbf-4ecb-803e-ca7e713501a9 could not be found. Jul 25 23:10:44.629342 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:10:44.629342 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:10:44.629342 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:10:44.629342 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:10:44.629342 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:10:44.629342 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:10:44.629342 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:10:44.629342 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:10:44.629342 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:10:44.630841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:10:44.630841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 23:10:44.630841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 23:10:44.630841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:10:44.630841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:10:44.630841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:10:44.630841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:10:44.630841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ccd6191d-8bbf-4ecb-803e-ca7e713501a9 could not be found. Jul 25 23:10:44.630841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:10:44.630841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:10:44.630841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:10:44.630841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:10:44.630841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:10:44.630841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:10:44.630841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:10:44.630841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:10:44.630841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ccd6191d-8bbf-4ecb-803e-ca7e713501a9 could not be found. Jul 25 23:10:44.630841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:10:44.632931 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-9c527a87-0b0a-4868-8b75-3d8c7ae4825f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Returning 404 to user: Instance ccd6191d-8bbf-4ecb-803e-ca7e713501a9 could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:10:44.632931 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-9c527a87-0b0a-4868-8b75-3d8c7ae4825f tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9" status: 404 len: 111 microversion: 2.1 time: 0.029763 Jul 25 23:10:44.632931 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 403/802] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:10:44 2022] GET /compute/v2.1/servers/ccd6191d-8bbf-4ecb-803e-ca7e713501a9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:10:45.066849 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-593df004-4d68-4bd3-b400-f9423e96cd1b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:45.067485 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-593df004-4d68-4bd3-b400-f9423e96cd1b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:45.074555 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-593df004-4d68-4bd3-b400-f9423e96cd1b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:45.074913 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-593df004-4d68-4bd3-b400-f9423e96cd1b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:45.075696 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-593df004-4d68-4bd3-b400-f9423e96cd1b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:45.076141 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-593df004-4d68-4bd3-b400-f9423e96cd1b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:45.216827 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-593df004-4d68-4bd3-b400-f9423e96cd1b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:45.224903 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-593df004-4d68-4bd3-b400-f9423e96cd1b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:45.226495 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-593df004-4d68-4bd3-b400-f9423e96cd1b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:10:45.227626 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-593df004-4d68-4bd3-b400-f9423e96cd1b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1717 microversion: 2.20 time: 0.164797 Jul 25 23:10:45.228171 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 400/803] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:10:45 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1717 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:10:45.880545 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4f355012-dbbf-40fc-8ef7-2a8dbfab580d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:45.881065 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4f355012-dbbf-40fc-8ef7-2a8dbfab580d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:45.887569 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4f355012-dbbf-40fc-8ef7-2a8dbfab580d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:45.888010 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4f355012-dbbf-40fc-8ef7-2a8dbfab580d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:45.888766 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4f355012-dbbf-40fc-8ef7-2a8dbfab580d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:45.889214 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4f355012-dbbf-40fc-8ef7-2a8dbfab580d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:45.903404 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-4f355012-dbbf-40fc-8ef7-2a8dbfab580d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] HTTP exception thrown: Instance 6efbf144-c03b-44d4-ad8f-0382560ed59d could not be found. Jul 25 23:10:45.904933 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4f355012-dbbf-40fc-8ef7-2a8dbfab580d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Request method failure captured: Jul 25 23:10:45.904933 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: request: DELETE /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d HTTP/1.1 Jul 25 23:10:45.904933 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 25 23:10:45.904933 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 25 23:10:45.904933 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Connection: close Jul 25 23:10:45.904933 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 25 23:10:45.904933 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 25 23:10:45.904933 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Host: 10.222.0.55 Jul 25 23:10:45.904933 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 25 23:10:45.904933 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.10 Jul 25 23:10:45.904933 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABi3yFo_tIojYVjGSyPNnsCOmVzSmhsMzU-aCps7S4Bg5YP14BzxTujy_Jw32T068wClp37u14xG0eRRAX-sOTSEox01hQPRKMnkl3sGuiXygMuZk_hwxD2nQAIdMbgyaG15J7NMphgvWwnthNIMAa88y8cvgOT1LG8zlva6Nrg9296ZxM Jul 25 23:10:45.904933 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 25 23:10:45.904933 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 25 23:10:45.904933 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 25 23:10:45.904933 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 25 23:10:45.904933 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 25 23:10:45.904933 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 25 23:10:45.904933 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Id: f0c3fc0630dd4083bcc8a9f70af99463 Jul 25 23:10:45.904933 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-AttachVolumeTestJSON-677038220 Jul 25 23:10:45.904933 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Role: reader,member Jul 25 23:10:45.904933 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Roles: reader,member Jul 25 23:10:45.906332 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f0c3fc0630dd4083bcc8a9f70af99463"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f0c3fc0630dd4083bcc8a9f70af99463"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f0c3fc0630dd4083bcc8a9f70af99463", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f0c3fc0630dd4083bcc8a9f70af99463"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:10:45.906332 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-AttachVolumeTestJSON-677038220 Jul 25 23:10:45.906332 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Id: f0c3fc0630dd4083bcc8a9f70af99463 Jul 25 23:10:45.906332 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-AttachVolumeTestJSON-677038220 Jul 25 23:10:45.906332 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User: tempest-AttachVolumeTestJSON-677038220-project Jul 25 23:10:45.906332 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 25 23:10:45.906332 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 25 23:10:45.906332 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Id: 4eea5a29c87d431299b220e404fd5732 Jul 25 23:10:45.906332 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-AttachVolumeTestJSON-677038220-project Jul 25 23:10:45.906332 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: method: > Jul 25 23:10:45.906332 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: exception: Instance 6efbf144-c03b-44d4-ad8f-0382560ed59d could not be found. Jul 25 23:10:45.906332 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: action_args: {'id': '6efbf144-c03b-44d4-ad8f-0382560ed59d'} Jul 25 23:10:45.907137 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:10:45.907137 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:10:45.907137 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:10:45.907137 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:10:45.907137 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:10:45.907137 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:10:45.907137 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:10:45.907137 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:10:45.907137 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:10:45.907137 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:10:45.907137 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6efbf144-c03b-44d4-ad8f-0382560ed59d could not be found. Jul 25 23:10:45.907137 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:10:45.907137 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:10:45.907137 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:10:45.907137 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:10:45.907137 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:10:45.907137 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:10:45.907137 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:10:45.907137 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:10:45.907137 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:10:45.908379 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:10:45.908379 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 23:10:45.908379 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 23:10:45.908379 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 23:10:45.908379 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 23:10:45.908379 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:10:45.908379 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:10:45.908379 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:10:45.908379 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:10:45.908379 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6efbf144-c03b-44d4-ad8f-0382560ed59d could not be found. Jul 25 23:10:45.908379 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:10:45.908379 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:10:45.908379 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:10:45.908379 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:10:45.908379 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:10:45.908379 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:10:45.908379 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:10:45.908379 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:10:45.908379 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6efbf144-c03b-44d4-ad8f-0382560ed59d could not be found. Jul 25 23:10:45.908379 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:10:45.909685 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4f355012-dbbf-40fc-8ef7-2a8dbfab580d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Returning 404 to user: Instance 6efbf144-c03b-44d4-ad8f-0382560ed59d could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:10:45.909685 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4f355012-dbbf-40fc-8ef7-2a8dbfab580d tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 404 len: 111 microversion: 2.1 time: 0.029716 Jul 25 23:10:45.909685 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 404/804] 10.222.0.55 () {58 vars in 1239 bytes} [Mon Jul 25 23:10:45 2022] DELETE /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:10:45.915532 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-985e725a-df52-4ed7-99eb-4b05bbe2a94b tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:10:45.916187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-985e725a-df52-4ed7-99eb-4b05bbe2a94b tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] [instance: 6efbf144-c03b-44d4-ad8f-0382560ed59d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:10:45.922697 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-985e725a-df52-4ed7-99eb-4b05bbe2a94b tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:45.923140 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-985e725a-df52-4ed7-99eb-4b05bbe2a94b tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:45.923901 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-985e725a-df52-4ed7-99eb-4b05bbe2a94b tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:10:45.924339 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-985e725a-df52-4ed7-99eb-4b05bbe2a94b tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:10:45.938184 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.wsgi [None req-985e725a-df52-4ed7-99eb-4b05bbe2a94b tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] HTTP exception thrown: Instance 6efbf144-c03b-44d4-ad8f-0382560ed59d could not be found. Jul 25 23:10:45.939700 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-985e725a-df52-4ed7-99eb-4b05bbe2a94b tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Request method failure captured: Jul 25 23:10:45.939700 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: request: GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d HTTP/1.1 Jul 25 23:10:45.939700 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept: application/json Jul 25 23:10:45.939700 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept-Encoding: identity Jul 25 23:10:45.939700 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Connection: close Jul 25 23:10:45.939700 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Length: 0 Jul 25 23:10:45.939700 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Type: application/json Jul 25 23:10:45.939700 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Host: 10.222.0.55 Jul 25 23:10:45.939700 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Openstack-System-Scope: None Jul 25 23:10:45.939700 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: User-Agent: python-urllib3/1.26.10 Jul 25 23:10:45.939700 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Auth-Token: gAAAAABi3yFo_tIojYVjGSyPNnsCOmVzSmhsMzU-aCps7S4Bg5YP14BzxTujy_Jw32T068wClp37u14xG0eRRAX-sOTSEox01hQPRKMnkl3sGuiXygMuZk_hwxD2nQAIdMbgyaG15J7NMphgvWwnthNIMAa88y8cvgOT1LG8zlva6Nrg9296ZxM Jul 25 23:10:45.939700 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Id: None Jul 25 23:10:45.939700 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Name: None Jul 25 23:10:45.939700 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Identity-Status: Confirmed Jul 25 23:10:45.939700 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Is-Admin-Project: True Jul 25 23:10:45.939700 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Id: default Jul 25 23:10:45.939700 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Name: Default Jul 25 23:10:45.939700 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Id: f0c3fc0630dd4083bcc8a9f70af99463 Jul 25 23:10:45.939700 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Name: tempest-AttachVolumeTestJSON-677038220 Jul 25 23:10:45.939700 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Role: reader,member Jul 25 23:10:45.939700 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Roles: reader,member Jul 25 23:10:45.941198 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f0c3fc0630dd4083bcc8a9f70af99463"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f0c3fc0630dd4083bcc8a9f70af99463"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f0c3fc0630dd4083bcc8a9f70af99463", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f0c3fc0630dd4083bcc8a9f70af99463"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:10:45.941198 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant: tempest-AttachVolumeTestJSON-677038220 Jul 25 23:10:45.941198 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Id: f0c3fc0630dd4083bcc8a9f70af99463 Jul 25 23:10:45.941198 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Name: tempest-AttachVolumeTestJSON-677038220 Jul 25 23:10:45.941198 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User: tempest-AttachVolumeTestJSON-677038220-project Jul 25 23:10:45.941198 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Id: default Jul 25 23:10:45.941198 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Name: Default Jul 25 23:10:45.941198 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Id: 4eea5a29c87d431299b220e404fd5732 Jul 25 23:10:45.941198 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Name: tempest-AttachVolumeTestJSON-677038220-project Jul 25 23:10:45.941198 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: method: > Jul 25 23:10:45.941198 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: exception: Instance 6efbf144-c03b-44d4-ad8f-0382560ed59d could not be found. Jul 25 23:10:45.941198 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: action_args: {'id': '6efbf144-c03b-44d4-ad8f-0382560ed59d'} Jul 25 23:10:45.942135 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:10:45.942135 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:10:45.942135 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:10:45.942135 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:10:45.942135 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:10:45.942135 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:10:45.942135 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:10:45.942135 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:10:45.942135 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:10:45.942135 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:10:45.942135 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6efbf144-c03b-44d4-ad8f-0382560ed59d could not be found. Jul 25 23:10:45.942135 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:10:45.942135 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:10:45.942135 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:10:45.942135 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:10:45.942135 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:10:45.942135 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:10:45.942135 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:10:45.942135 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:10:45.942135 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:10:45.943578 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:10:45.943578 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 23:10:45.943578 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 23:10:45.943578 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:10:45.943578 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:10:45.943578 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:10:45.943578 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:10:45.943578 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6efbf144-c03b-44d4-ad8f-0382560ed59d could not be found. Jul 25 23:10:45.943578 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:10:45.943578 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:10:45.943578 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:10:45.943578 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:10:45.943578 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:10:45.943578 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:10:45.943578 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:10:45.943578 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:10:45.943578 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6efbf144-c03b-44d4-ad8f-0382560ed59d could not be found. Jul 25 23:10:45.943578 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:10:45.945763 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-985e725a-df52-4ed7-99eb-4b05bbe2a94b tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] Returning 404 to user: Instance 6efbf144-c03b-44d4-ad8f-0382560ed59d could not be found. {{(pid=118409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:10:45.945763 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-985e725a-df52-4ed7-99eb-4b05bbe2a94b tempest-AttachVolumeTestJSON-677038220 tempest-AttachVolumeTestJSON-677038220-project] 10.222.0.55 "GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d" status: 404 len: 111 microversion: 2.1 time: 0.030046 Jul 25 23:10:45.945763 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 401/805] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:10:45 2022] GET /compute/v2.1/servers/6efbf144-c03b-44d4-ad8f-0382560ed59d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:11:16.545684 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-9de773b3-fe87-4367-978b-5cf9e5144998 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:16.548027 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-9de773b3-fe87-4367-978b-5cf9e5144998 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:16.550095 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=15 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:11:16.550760 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=10 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:11:16.556289 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9de773b3-fe87-4367-978b-5cf9e5144998 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:16.556733 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9de773b3-fe87-4367-978b-5cf9e5144998 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:16.557538 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9de773b3-fe87-4367-978b-5cf9e5144998 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:16.557970 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9de773b3-fe87-4367-978b-5cf9e5144998 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:16.587851 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-9de773b3-fe87-4367-978b-5cf9e5144998 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046007 Jul 25 23:11:16.588409 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 405/806] 10.222.0.55 () {60 vars in 1343 bytes} [Mon Jul 25 23:11:16 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:11:16.654477 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-a8b5f72d-60d5-49c1-9bb6-f1035db2ce0c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:16.655124 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-a8b5f72d-60d5-49c1-9bb6-f1035db2ce0c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:16.657335 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:11:16.662740 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=66 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:11:16.662883 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a8b5f72d-60d5-49c1-9bb6-f1035db2ce0c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:16.663347 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a8b5f72d-60d5-49c1-9bb6-f1035db2ce0c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:16.664108 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a8b5f72d-60d5-49c1-9bb6-f1035db2ce0c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:16.665589 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a8b5f72d-60d5-49c1-9bb6-f1035db2ce0c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:16.691907 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-a8b5f72d-60d5-49c1-9bb6-f1035db2ce0c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Going to try to terminate instance {{(pid=118409) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 23:11:17.050227 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-a8b5f72d-60d5-49c1-9bb6-f1035db2ce0c tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "DELETE /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 204 len: 0 microversion: 2.20 time: 0.399297 Jul 25 23:11:17.050722 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 402/807] 10.222.0.55 () {60 vars in 1280 bytes} [Mon Jul 25 23:11:16 2022] DELETE /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 23:11:17.059066 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-fd27e3ad-a814-4b1b-9d61-4abb46545f42 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:17.059676 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-fd27e3ad-a814-4b1b-9d61-4abb46545f42 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:17.066632 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fd27e3ad-a814-4b1b-9d61-4abb46545f42 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:17.071241 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fd27e3ad-a814-4b1b-9d61-4abb46545f42 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:17.071241 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fd27e3ad-a814-4b1b-9d61-4abb46545f42 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:17.071241 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fd27e3ad-a814-4b1b-9d61-4abb46545f42 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:17.212979 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-fd27e3ad-a814-4b1b-9d61-4abb46545f42 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:17.222138 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-fd27e3ad-a814-4b1b-9d61-4abb46545f42 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:17.223650 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-fd27e3ad-a814-4b1b-9d61-4abb46545f42 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:17.224827 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-fd27e3ad-a814-4b1b-9d61-4abb46545f42 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1723 microversion: 2.20 time: 0.169726 Jul 25 23:11:17.225437 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 406/808] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:11:17 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:11:18.249265 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-b2519bb2-26f2-466b-a3a9-697c297f6a65 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:18.249980 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-b2519bb2-26f2-466b-a3a9-697c297f6a65 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:18.256929 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b2519bb2-26f2-466b-a3a9-697c297f6a65 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:18.257393 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b2519bb2-26f2-466b-a3a9-697c297f6a65 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:18.258217 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b2519bb2-26f2-466b-a3a9-697c297f6a65 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:18.258654 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b2519bb2-26f2-466b-a3a9-697c297f6a65 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:18.391198 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-b2519bb2-26f2-466b-a3a9-697c297f6a65 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:18.400192 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-b2519bb2-26f2-466b-a3a9-697c297f6a65 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:18.401752 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-b2519bb2-26f2-466b-a3a9-697c297f6a65 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:18.402916 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-b2519bb2-26f2-466b-a3a9-697c297f6a65 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1723 microversion: 2.20 time: 0.157911 Jul 25 23:11:18.403473 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 403/809] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:11:18 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:11:19.426615 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-7c3a3fdf-6b34-4370-a5f0-849870701cce tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:19.427222 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-7c3a3fdf-6b34-4370-a5f0-849870701cce tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:19.434903 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7c3a3fdf-6b34-4370-a5f0-849870701cce tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:19.435355 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7c3a3fdf-6b34-4370-a5f0-849870701cce tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:19.436136 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7c3a3fdf-6b34-4370-a5f0-849870701cce tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:19.436569 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7c3a3fdf-6b34-4370-a5f0-849870701cce tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:19.469541 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-f2d18664-516c-41f8-bb37-e7cd71df9086 req-3277d609-2919-470f-b016-c86a1810978c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5f69472-1864-4211-b288-44e579367954", "name": "network-vif-deleted", "tag": "c6685a7a-bff1-4d27-8daf-0e1614096b58"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:11:19.480524 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-f2d18664-516c-41f8-bb37-e7cd71df9086 req-3277d609-2919-470f-b016-c86a1810978c service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:19.480963 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-f2d18664-516c-41f8-bb37-e7cd71df9086 req-3277d609-2919-470f-b016-c86a1810978c service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:19.493276 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-f2d18664-516c-41f8-bb37-e7cd71df9086 req-3277d609-2919-470f-b016-c86a1810978c service nova] Creating event network-vif-deleted:c6685a7a-bff1-4d27-8daf-0e1614096b58 for instance c5f69472-1864-4211-b288-44e579367954 on hv-cinder-79760 Jul 25 23:11:19.498320 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-f2d18664-516c-41f8-bb37-e7cd71df9086 req-3277d609-2919-470f-b016-c86a1810978c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032511 Jul 25 23:11:19.499331 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 404/810] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 23:11:19.513782 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7c3a3fdf-6b34-4370-a5f0-849870701cce tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:19.522507 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7c3a3fdf-6b34-4370-a5f0-849870701cce tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:19.524050 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7c3a3fdf-6b34-4370-a5f0-849870701cce tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fbc4fc1f207c4726b9c05b6b338f0e9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16a417bb74d445f7b2240ccb27061f05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:19.525442 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-7c3a3fdf-6b34-4370-a5f0-849870701cce tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 200 len: 1656 microversion: 2.20 time: 0.102725 Jul 25 23:11:19.526018 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 407/811] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:11:19 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 1656 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 25 23:11:20.551001 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-5dbde13b-0ae2-47ff-adfb-24d04ae17aa8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:20.552198 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-5dbde13b-0ae2-47ff-adfb-24d04ae17aa8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:20.559962 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5dbde13b-0ae2-47ff-adfb-24d04ae17aa8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:20.560407 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5dbde13b-0ae2-47ff-adfb-24d04ae17aa8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:20.561204 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5dbde13b-0ae2-47ff-adfb-24d04ae17aa8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:20.561637 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5dbde13b-0ae2-47ff-adfb-24d04ae17aa8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:20.575740 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.wsgi [None req-5dbde13b-0ae2-47ff-adfb-24d04ae17aa8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] HTTP exception thrown: Instance c5f69472-1864-4211-b288-44e579367954 could not be found. Jul 25 23:11:20.577467 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-5dbde13b-0ae2-47ff-adfb-24d04ae17aa8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Request method failure captured: Jul 25 23:11:20.577467 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: request: GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 HTTP/1.1 Jul 25 23:11:20.577467 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept: application/json Jul 25 23:11:20.577467 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept-Encoding: identity Jul 25 23:11:20.577467 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Connection: close Jul 25 23:11:20.577467 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Length: 0 Jul 25 23:11:20.577467 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Type: application/json Jul 25 23:11:20.577467 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Host: 10.222.0.55 Jul 25 23:11:20.577467 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Openstack-System-Scope: None Jul 25 23:11:20.577467 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: User-Agent: python-urllib3/1.26.10 Jul 25 23:11:20.577467 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Auth-Token: gAAAAABi3yFo2oTM5L4NBrfb4jUXltmZfGsPYH9vcd3JJO5drEnrQWguvjzFRHQ7UAOmAzMrpXBLzLuc0B0_xLvtE6w0fH2UiGwmWBDnd0_Gx5CPktIzwcoWl3s4Aj8fpHfpXij2hITgR13pVXdrLCLI7L9z64TMoTPPRIwJWMUQiSIFvsS23Bs Jul 25 23:11:20.577467 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Id: None Jul 25 23:11:20.577467 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Name: None Jul 25 23:11:20.577467 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Identity-Status: Confirmed Jul 25 23:11:20.577467 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Is-Admin-Project: True Jul 25 23:11:20.577467 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 23:11:20.577467 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Id: default Jul 25 23:11:20.577467 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Name: Default Jul 25 23:11:20.577467 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Id: 16a417bb74d445f7b2240ccb27061f05 Jul 25 23:11:20.577467 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-208491806 Jul 25 23:11:20.577467 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Role: reader,member Jul 25 23:11:20.577467 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Roles: reader,member Jul 25 23:11:20.579259 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/16a417bb74d445f7b2240ccb27061f05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/16a417bb74d445f7b2240ccb27061f05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_16a417bb74d445f7b2240ccb27061f05", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/16a417bb74d445f7b2240ccb27061f05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:11:20.579259 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant: tempest-AttachVolumeShelveTestJSON-208491806 Jul 25 23:11:20.579259 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Id: 16a417bb74d445f7b2240ccb27061f05 Jul 25 23:11:20.579259 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-208491806 Jul 25 23:11:20.579259 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User: tempest-AttachVolumeShelveTestJSON-208491806-project Jul 25 23:11:20.579259 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Id: default Jul 25 23:11:20.579259 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Name: Default Jul 25 23:11:20.579259 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Id: fbc4fc1f207c4726b9c05b6b338f0e9c Jul 25 23:11:20.579259 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Name: tempest-AttachVolumeShelveTestJSON-208491806-project Jul 25 23:11:20.579259 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: method: > Jul 25 23:11:20.579259 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: exception: Instance c5f69472-1864-4211-b288-44e579367954 could not be found. Jul 25 23:11:20.579259 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: action_args: {'id': 'c5f69472-1864-4211-b288-44e579367954'} Jul 25 23:11:20.580019 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:11:20.580019 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:11:20.580019 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:11:20.580019 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:11:20.580019 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:11:20.580019 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:11:20.580019 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:11:20.580019 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:11:20.580019 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:11:20.580019 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:11:20.580019 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5f69472-1864-4211-b288-44e579367954 could not be found. Jul 25 23:11:20.580019 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:11:20.580019 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:11:20.580019 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:11:20.580019 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:11:20.580019 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:11:20.580019 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:11:20.580019 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:11:20.580019 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:11:20.580019 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:11:20.582793 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:11:20.582793 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 23:11:20.582793 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 23:11:20.582793 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:11:20.582793 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:11:20.582793 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:11:20.582793 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:11:20.582793 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5f69472-1864-4211-b288-44e579367954 could not be found. Jul 25 23:11:20.582793 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:11:20.582793 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:11:20.582793 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:11:20.582793 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:11:20.582793 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:11:20.582793 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:11:20.582793 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:11:20.582793 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:11:20.582793 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5f69472-1864-4211-b288-44e579367954 could not be found. Jul 25 23:11:20.582793 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:11:20.584134 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-5dbde13b-0ae2-47ff-adfb-24d04ae17aa8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Returning 404 to user: Instance c5f69472-1864-4211-b288-44e579367954 could not be found. {{(pid=118409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:11:20.584134 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-5dbde13b-0ae2-47ff-adfb-24d04ae17aa8 tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 404 len: 111 microversion: 2.20 time: 0.032659 Jul 25 23:11:20.584134 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 405/812] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:11:20 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 23:11:20.588050 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4d7f94c4-09e4-4db4-939d-8f6a7a19a56e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '.version_select at 0x7f6226e75ca0>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:20.656609 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4d7f94c4-09e4-4db4-939d-8f6a7a19a56e tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1693911719" status: 204 len: 0 microversion: 2.20 time: 0.072428 Jul 25 23:11:20.657216 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 408/813] 10.222.0.55 () {60 vars in 1262 bytes} [Mon Jul 25 23:11:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1693911719 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 25 23:11:22.661567 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-73e99aad-c263-4c25-855d-e2d6b82db9ff tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:22.662107 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-73e99aad-c263-4c25-855d-e2d6b82db9ff tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:22.668705 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-73e99aad-c263-4c25-855d-e2d6b82db9ff tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:22.669241 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-73e99aad-c263-4c25-855d-e2d6b82db9ff tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:22.670007 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-73e99aad-c263-4c25-855d-e2d6b82db9ff tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:22.670431 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-73e99aad-c263-4c25-855d-e2d6b82db9ff tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:22.684232 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.wsgi [None req-73e99aad-c263-4c25-855d-e2d6b82db9ff tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] HTTP exception thrown: Instance c5f69472-1864-4211-b288-44e579367954 could not be found. Jul 25 23:11:22.685905 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-73e99aad-c263-4c25-855d-e2d6b82db9ff tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Request method failure captured: Jul 25 23:11:22.685905 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: request: DELETE /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 HTTP/1.1 Jul 25 23:11:22.685905 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept: application/json Jul 25 23:11:22.685905 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept-Encoding: identity Jul 25 23:11:22.685905 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Connection: close Jul 25 23:11:22.685905 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Length: 0 Jul 25 23:11:22.685905 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Type: application/json Jul 25 23:11:22.685905 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Host: 10.222.0.55 Jul 25 23:11:22.685905 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Openstack-System-Scope: None Jul 25 23:11:22.685905 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: User-Agent: python-urllib3/1.26.10 Jul 25 23:11:22.685905 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Auth-Token: gAAAAABi3yFo2oTM5L4NBrfb4jUXltmZfGsPYH9vcd3JJO5drEnrQWguvjzFRHQ7UAOmAzMrpXBLzLuc0B0_xLvtE6w0fH2UiGwmWBDnd0_Gx5CPktIzwcoWl3s4Aj8fpHfpXij2hITgR13pVXdrLCLI7L9z64TMoTPPRIwJWMUQiSIFvsS23Bs Jul 25 23:11:22.685905 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Id: None Jul 25 23:11:22.685905 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Name: None Jul 25 23:11:22.685905 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Identity-Status: Confirmed Jul 25 23:11:22.685905 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Is-Admin-Project: True Jul 25 23:11:22.685905 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 23:11:22.685905 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Id: default Jul 25 23:11:22.685905 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Name: Default Jul 25 23:11:22.685905 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Id: 16a417bb74d445f7b2240ccb27061f05 Jul 25 23:11:22.685905 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-208491806 Jul 25 23:11:22.685905 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Role: reader,member Jul 25 23:11:22.685905 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Roles: reader,member Jul 25 23:11:22.687522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/16a417bb74d445f7b2240ccb27061f05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/16a417bb74d445f7b2240ccb27061f05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_16a417bb74d445f7b2240ccb27061f05", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/16a417bb74d445f7b2240ccb27061f05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:11:22.687522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant: tempest-AttachVolumeShelveTestJSON-208491806 Jul 25 23:11:22.687522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Id: 16a417bb74d445f7b2240ccb27061f05 Jul 25 23:11:22.687522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-208491806 Jul 25 23:11:22.687522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User: tempest-AttachVolumeShelveTestJSON-208491806-project Jul 25 23:11:22.687522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Id: default Jul 25 23:11:22.687522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Name: Default Jul 25 23:11:22.687522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Id: fbc4fc1f207c4726b9c05b6b338f0e9c Jul 25 23:11:22.687522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Name: tempest-AttachVolumeShelveTestJSON-208491806-project Jul 25 23:11:22.687522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: method: > Jul 25 23:11:22.687522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: exception: Instance c5f69472-1864-4211-b288-44e579367954 could not be found. Jul 25 23:11:22.687522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: action_args: {'id': 'c5f69472-1864-4211-b288-44e579367954'} Jul 25 23:11:22.688539 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:11:22.688539 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:11:22.688539 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:11:22.688539 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:11:22.688539 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:11:22.688539 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:11:22.688539 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:11:22.688539 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:11:22.688539 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:11:22.688539 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:11:22.688539 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5f69472-1864-4211-b288-44e579367954 could not be found. Jul 25 23:11:22.688539 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:11:22.688539 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:11:22.688539 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:11:22.688539 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:11:22.688539 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:11:22.688539 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:11:22.688539 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:11:22.688539 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:11:22.688539 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:11:22.689789 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:11:22.689789 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 23:11:22.689789 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 23:11:22.689789 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 23:11:22.689789 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 23:11:22.689789 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:11:22.689789 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:11:22.689789 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:11:22.689789 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:11:22.689789 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5f69472-1864-4211-b288-44e579367954 could not be found. Jul 25 23:11:22.689789 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:11:22.689789 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:11:22.689789 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:11:22.689789 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:11:22.689789 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:11:22.689789 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:11:22.689789 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:11:22.689789 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:11:22.689789 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5f69472-1864-4211-b288-44e579367954 could not be found. Jul 25 23:11:22.689789 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:11:22.691502 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-73e99aad-c263-4c25-855d-e2d6b82db9ff tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Returning 404 to user: Instance c5f69472-1864-4211-b288-44e579367954 could not be found. {{(pid=118409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:11:22.691502 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-73e99aad-c263-4c25-855d-e2d6b82db9ff tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "DELETE /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 404 len: 111 microversion: 2.20 time: 0.029742 Jul 25 23:11:22.691502 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 406/814] 10.222.0.55 () {60 vars in 1280 bytes} [Mon Jul 25 23:11:22 2022] DELETE /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 23:11:22.699576 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-09efcb4d-5da2-4756-82e3-2af99bb5b25b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:22.700178 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-09efcb4d-5da2-4756-82e3-2af99bb5b25b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: c5f69472-1864-4211-b288-44e579367954] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:22.706900 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-09efcb4d-5da2-4756-82e3-2af99bb5b25b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:22.707342 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-09efcb4d-5da2-4756-82e3-2af99bb5b25b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:22.708145 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-09efcb4d-5da2-4756-82e3-2af99bb5b25b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:22.708579 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-09efcb4d-5da2-4756-82e3-2af99bb5b25b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:22.723001 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-09efcb4d-5da2-4756-82e3-2af99bb5b25b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] HTTP exception thrown: Instance c5f69472-1864-4211-b288-44e579367954 could not be found. Jul 25 23:11:22.724557 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-09efcb4d-5da2-4756-82e3-2af99bb5b25b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Request method failure captured: Jul 25 23:11:22.724557 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 HTTP/1.1 Jul 25 23:11:22.724557 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 25 23:11:22.724557 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 25 23:11:22.724557 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Connection: close Jul 25 23:11:22.724557 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 25 23:11:22.724557 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 25 23:11:22.724557 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Host: 10.222.0.55 Jul 25 23:11:22.724557 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 25 23:11:22.724557 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.10 Jul 25 23:11:22.724557 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABi3yFo2oTM5L4NBrfb4jUXltmZfGsPYH9vcd3JJO5drEnrQWguvjzFRHQ7UAOmAzMrpXBLzLuc0B0_xLvtE6w0fH2UiGwmWBDnd0_Gx5CPktIzwcoWl3s4Aj8fpHfpXij2hITgR13pVXdrLCLI7L9z64TMoTPPRIwJWMUQiSIFvsS23Bs Jul 25 23:11:22.724557 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 25 23:11:22.724557 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 25 23:11:22.724557 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 25 23:11:22.724557 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 25 23:11:22.724557 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 23:11:22.724557 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 25 23:11:22.724557 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 25 23:11:22.724557 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Id: 16a417bb74d445f7b2240ccb27061f05 Jul 25 23:11:22.724557 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-208491806 Jul 25 23:11:22.724557 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Role: reader,member Jul 25 23:11:22.724557 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Roles: reader,member Jul 25 23:11:22.725991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/16a417bb74d445f7b2240ccb27061f05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/16a417bb74d445f7b2240ccb27061f05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_16a417bb74d445f7b2240ccb27061f05", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/16a417bb74d445f7b2240ccb27061f05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:11:22.725991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-AttachVolumeShelveTestJSON-208491806 Jul 25 23:11:22.725991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Id: 16a417bb74d445f7b2240ccb27061f05 Jul 25 23:11:22.725991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-208491806 Jul 25 23:11:22.725991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User: tempest-AttachVolumeShelveTestJSON-208491806-project Jul 25 23:11:22.725991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 25 23:11:22.725991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 25 23:11:22.725991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Id: fbc4fc1f207c4726b9c05b6b338f0e9c Jul 25 23:11:22.725991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-AttachVolumeShelveTestJSON-208491806-project Jul 25 23:11:22.725991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: method: > Jul 25 23:11:22.725991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: exception: Instance c5f69472-1864-4211-b288-44e579367954 could not be found. Jul 25 23:11:22.725991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: action_args: {'id': 'c5f69472-1864-4211-b288-44e579367954'} Jul 25 23:11:22.727015 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:11:22.727015 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:11:22.727015 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:11:22.727015 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:11:22.727015 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:11:22.727015 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:11:22.727015 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:11:22.727015 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:11:22.727015 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:11:22.727015 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:11:22.727015 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5f69472-1864-4211-b288-44e579367954 could not be found. Jul 25 23:11:22.727015 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:11:22.727015 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:11:22.727015 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:11:22.727015 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:11:22.727015 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:11:22.727015 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:11:22.727015 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:11:22.727015 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:11:22.727015 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:11:22.728280 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:11:22.728280 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 23:11:22.728280 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 23:11:22.728280 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:11:22.728280 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:11:22.728280 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:11:22.728280 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:11:22.728280 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5f69472-1864-4211-b288-44e579367954 could not be found. Jul 25 23:11:22.728280 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:11:22.728280 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:11:22.728280 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:11:22.728280 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:11:22.728280 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:11:22.728280 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:11:22.728280 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:11:22.728280 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:11:22.728280 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5f69472-1864-4211-b288-44e579367954 could not be found. Jul 25 23:11:22.728280 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:11:22.729402 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-09efcb4d-5da2-4756-82e3-2af99bb5b25b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Returning 404 to user: Instance c5f69472-1864-4211-b288-44e579367954 could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:11:22.729402 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-09efcb4d-5da2-4756-82e3-2af99bb5b25b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954" status: 404 len: 111 microversion: 2.20 time: 0.033067 Jul 25 23:11:22.729402 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 409/815] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:11:22 2022] GET /compute/v2.1/servers/c5f69472-1864-4211-b288-44e579367954 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 23:11:24.015859 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-8ac4233d-573c-48f6-89a3-127ff765fc6b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:24.016357 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-8ac4233d-573c-48f6-89a3-127ff765fc6b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:24.023161 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8ac4233d-573c-48f6-89a3-127ff765fc6b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:24.023613 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8ac4233d-573c-48f6-89a3-127ff765fc6b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:24.024971 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8ac4233d-573c-48f6-89a3-127ff765fc6b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:24.025434 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8ac4233d-573c-48f6-89a3-127ff765fc6b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:24.038598 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.wsgi [None req-8ac4233d-573c-48f6-89a3-127ff765fc6b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] HTTP exception thrown: Instance e78f6354-b88d-45a6-817b-4ef206d07d33 could not be found. Jul 25 23:11:24.040187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-8ac4233d-573c-48f6-89a3-127ff765fc6b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Request method failure captured: Jul 25 23:11:24.040187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: request: DELETE /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 HTTP/1.1 Jul 25 23:11:24.040187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept: application/json Jul 25 23:11:24.040187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept-Encoding: identity Jul 25 23:11:24.040187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Connection: close Jul 25 23:11:24.040187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Length: 0 Jul 25 23:11:24.040187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Type: application/json Jul 25 23:11:24.040187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Host: 10.222.0.55 Jul 25 23:11:24.040187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Openstack-System-Scope: None Jul 25 23:11:24.040187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: User-Agent: python-urllib3/1.26.10 Jul 25 23:11:24.040187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Auth-Token: gAAAAABi3yFo2oTM5L4NBrfb4jUXltmZfGsPYH9vcd3JJO5drEnrQWguvjzFRHQ7UAOmAzMrpXBLzLuc0B0_xLvtE6w0fH2UiGwmWBDnd0_Gx5CPktIzwcoWl3s4Aj8fpHfpXij2hITgR13pVXdrLCLI7L9z64TMoTPPRIwJWMUQiSIFvsS23Bs Jul 25 23:11:24.040187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Id: None Jul 25 23:11:24.040187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Name: None Jul 25 23:11:24.040187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Identity-Status: Confirmed Jul 25 23:11:24.040187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Is-Admin-Project: True Jul 25 23:11:24.040187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 23:11:24.040187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Id: default Jul 25 23:11:24.040187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Name: Default Jul 25 23:11:24.040187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Id: 16a417bb74d445f7b2240ccb27061f05 Jul 25 23:11:24.040187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-208491806 Jul 25 23:11:24.040187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Role: reader,member Jul 25 23:11:24.040187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Roles: reader,member Jul 25 23:11:24.041866 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/16a417bb74d445f7b2240ccb27061f05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/16a417bb74d445f7b2240ccb27061f05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_16a417bb74d445f7b2240ccb27061f05", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/16a417bb74d445f7b2240ccb27061f05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:11:24.041866 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant: tempest-AttachVolumeShelveTestJSON-208491806 Jul 25 23:11:24.041866 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Id: 16a417bb74d445f7b2240ccb27061f05 Jul 25 23:11:24.041866 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-208491806 Jul 25 23:11:24.041866 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User: tempest-AttachVolumeShelveTestJSON-208491806-project Jul 25 23:11:24.041866 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Id: default Jul 25 23:11:24.041866 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Name: Default Jul 25 23:11:24.041866 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Id: fbc4fc1f207c4726b9c05b6b338f0e9c Jul 25 23:11:24.041866 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Name: tempest-AttachVolumeShelveTestJSON-208491806-project Jul 25 23:11:24.041866 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: method: > Jul 25 23:11:24.041866 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: exception: Instance e78f6354-b88d-45a6-817b-4ef206d07d33 could not be found. Jul 25 23:11:24.041866 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: action_args: {'id': 'e78f6354-b88d-45a6-817b-4ef206d07d33'} Jul 25 23:11:24.042721 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:11:24.042721 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:11:24.042721 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:11:24.042721 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:11:24.042721 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:11:24.042721 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:11:24.042721 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:11:24.042721 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:11:24.042721 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:11:24.042721 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:11:24.042721 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e78f6354-b88d-45a6-817b-4ef206d07d33 could not be found. Jul 25 23:11:24.042721 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:11:24.042721 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:11:24.042721 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:11:24.042721 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:11:24.042721 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:11:24.042721 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:11:24.042721 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:11:24.042721 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:11:24.042721 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:11:24.044016 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:11:24.044016 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 23:11:24.044016 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 23:11:24.044016 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 23:11:24.044016 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 23:11:24.044016 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:11:24.044016 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:11:24.044016 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:11:24.044016 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:11:24.044016 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e78f6354-b88d-45a6-817b-4ef206d07d33 could not be found. Jul 25 23:11:24.044016 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:11:24.044016 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:11:24.044016 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:11:24.044016 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:11:24.044016 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:11:24.044016 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:11:24.044016 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:11:24.044016 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:11:24.044016 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e78f6354-b88d-45a6-817b-4ef206d07d33 could not be found. Jul 25 23:11:24.044016 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:11:24.045457 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-8ac4233d-573c-48f6-89a3-127ff765fc6b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Returning 404 to user: Instance e78f6354-b88d-45a6-817b-4ef206d07d33 could not be found. {{(pid=118409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:11:24.045457 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-8ac4233d-573c-48f6-89a3-127ff765fc6b tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "DELETE /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 404 len: 111 microversion: 2.20 time: 0.029806 Jul 25 23:11:24.045457 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 407/816] 10.222.0.55 () {60 vars in 1280 bytes} [Mon Jul 25 23:11:24 2022] DELETE /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 23:11:24.050865 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4ab62220-6ae1-40a7-963c-c9afef70ccbc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:24.051476 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4ab62220-6ae1-40a7-963c-c9afef70ccbc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] [instance: e78f6354-b88d-45a6-817b-4ef206d07d33] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:24.057941 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4ab62220-6ae1-40a7-963c-c9afef70ccbc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:24.058395 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4ab62220-6ae1-40a7-963c-c9afef70ccbc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:24.059208 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4ab62220-6ae1-40a7-963c-c9afef70ccbc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:24.059662 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4ab62220-6ae1-40a7-963c-c9afef70ccbc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:24.075146 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-4ab62220-6ae1-40a7-963c-c9afef70ccbc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] HTTP exception thrown: Instance e78f6354-b88d-45a6-817b-4ef206d07d33 could not be found. Jul 25 23:11:24.076670 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4ab62220-6ae1-40a7-963c-c9afef70ccbc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Request method failure captured: Jul 25 23:11:24.076670 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 HTTP/1.1 Jul 25 23:11:24.076670 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 25 23:11:24.076670 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 25 23:11:24.076670 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Connection: close Jul 25 23:11:24.076670 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 25 23:11:24.076670 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 25 23:11:24.076670 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Host: 10.222.0.55 Jul 25 23:11:24.076670 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 25 23:11:24.076670 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.10 Jul 25 23:11:24.076670 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABi3yFo2oTM5L4NBrfb4jUXltmZfGsPYH9vcd3JJO5drEnrQWguvjzFRHQ7UAOmAzMrpXBLzLuc0B0_xLvtE6w0fH2UiGwmWBDnd0_Gx5CPktIzwcoWl3s4Aj8fpHfpXij2hITgR13pVXdrLCLI7L9z64TMoTPPRIwJWMUQiSIFvsS23Bs Jul 25 23:11:24.076670 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 25 23:11:24.076670 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 25 23:11:24.076670 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 25 23:11:24.076670 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 25 23:11:24.076670 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Openstack-Nova-Api-Version: 2.20 Jul 25 23:11:24.076670 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 25 23:11:24.076670 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 25 23:11:24.076670 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Id: 16a417bb74d445f7b2240ccb27061f05 Jul 25 23:11:24.076670 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-208491806 Jul 25 23:11:24.076670 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Role: reader,member Jul 25 23:11:24.076670 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Roles: reader,member Jul 25 23:11:24.078282 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/16a417bb74d445f7b2240ccb27061f05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/16a417bb74d445f7b2240ccb27061f05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_16a417bb74d445f7b2240ccb27061f05", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/16a417bb74d445f7b2240ccb27061f05"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:11:24.078282 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-AttachVolumeShelveTestJSON-208491806 Jul 25 23:11:24.078282 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Id: 16a417bb74d445f7b2240ccb27061f05 Jul 25 23:11:24.078282 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-208491806 Jul 25 23:11:24.078282 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User: tempest-AttachVolumeShelveTestJSON-208491806-project Jul 25 23:11:24.078282 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 25 23:11:24.078282 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 25 23:11:24.078282 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Id: fbc4fc1f207c4726b9c05b6b338f0e9c Jul 25 23:11:24.078282 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-AttachVolumeShelveTestJSON-208491806-project Jul 25 23:11:24.078282 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: method: > Jul 25 23:11:24.078282 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: exception: Instance e78f6354-b88d-45a6-817b-4ef206d07d33 could not be found. Jul 25 23:11:24.078282 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: action_args: {'id': 'e78f6354-b88d-45a6-817b-4ef206d07d33'} Jul 25 23:11:24.079317 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:11:24.079317 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:11:24.079317 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:11:24.079317 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:11:24.079317 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:11:24.079317 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:11:24.079317 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:11:24.079317 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:11:24.079317 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:11:24.079317 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:11:24.079317 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e78f6354-b88d-45a6-817b-4ef206d07d33 could not be found. Jul 25 23:11:24.079317 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:11:24.079317 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:11:24.079317 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:11:24.079317 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:11:24.079317 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:11:24.079317 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:11:24.079317 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:11:24.079317 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:11:24.079317 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:11:24.080707 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:11:24.080707 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 23:11:24.080707 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 23:11:24.080707 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:11:24.080707 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:11:24.080707 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:11:24.080707 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:11:24.080707 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e78f6354-b88d-45a6-817b-4ef206d07d33 could not be found. Jul 25 23:11:24.080707 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:11:24.080707 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:11:24.080707 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:11:24.080707 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:11:24.080707 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:11:24.080707 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:11:24.080707 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:11:24.080707 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:11:24.080707 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e78f6354-b88d-45a6-817b-4ef206d07d33 could not be found. Jul 25 23:11:24.080707 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:11:24.085516 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4ab62220-6ae1-40a7-963c-c9afef70ccbc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] Returning 404 to user: Instance e78f6354-b88d-45a6-817b-4ef206d07d33 could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:11:24.085516 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4ab62220-6ae1-40a7-963c-c9afef70ccbc tempest-AttachVolumeShelveTestJSON-208491806 tempest-AttachVolumeShelveTestJSON-208491806-project] 10.222.0.55 "GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33" status: 404 len: 111 microversion: 2.20 time: 0.031174 Jul 25 23:11:24.085516 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 410/817] 10.222.0.55 () {60 vars in 1277 bytes} [Mon Jul 25 23:11:24 2022] GET /compute/v2.1/servers/e78f6354-b88d-45a6-817b-4ef206d07d33 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 25 23:11:31.079048 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-ee6539dc-c4ac-4986-9f3a-9c46123a3999 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2124849124", "imageRef": "8e9f3265-0fdf-483a-8e2e-41d408f5f0e7", "flavorRef": "452", "networks": [{"uuid": "ec47b4be-bddf-4a70-a6d5-ad18a4d61efa"}]}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:11:31.133878 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.network.neutron [None req-ee6539dc-c4ac-4986-9f3a-9c46123a3999 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] validate_networks() for [('ec47b4be-bddf-4a70-a6d5-ad18a4d61efa', None, None, None, None, None)] {{(pid=118409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 23:11:31.545570 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-ee6539dc-c4ac-4986-9f3a-9c46123a3999 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Flavor limits 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 23:11:31.549042 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-ee6539dc-c4ac-4986-9f3a-9c46123a3999 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Image limits 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 23:11:31.549042 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-ee6539dc-c4ac-4986-9f3a-9c46123a3999 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Flavor pref 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 23:11:31.549042 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-ee6539dc-c4ac-4986-9f3a-9c46123a3999 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Image pref 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 23:11:31.549042 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-ee6539dc-c4ac-4986-9f3a-9c46123a3999 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 23:11:31.557610 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ee6539dc-c4ac-4986-9f3a-9c46123a3999 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:31.558065 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ee6539dc-c4ac-4986-9f3a-9c46123a3999 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:31.559033 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ee6539dc-c4ac-4986-9f3a-9c46123a3999 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:31.559463 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ee6539dc-c4ac-4986-9f3a-9c46123a3999 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:31.579319 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-ee6539dc-c4ac-4986-9f3a-9c46123a3999 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Getting quotas for project 723890dbe52c422ba8347b7b842a0cd9. Resources: {'instances', 'cores', 'ram'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 23:11:31.584926 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-ee6539dc-c4ac-4986-9f3a-9c46123a3999 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Getting quotas for user 560c53f082994abdb68e8b7113fc5831 and project 723890dbe52c422ba8347b7b842a0cd9. Resources: {'instances', 'cores', 'ram'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 23:11:31.600963 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-ee6539dc-c4ac-4986-9f3a-9c46123a3999 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Going to run 1 instances... {{(pid=118409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 23:11:31.604696 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-ee6539dc-c4ac-4986-9f3a-9c46123a3999 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] [instance: 57d8ce25-48a4-41be-9813-53386a25477c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e9f3265-0fdf-483a-8e2e-41d408f5f0e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 23:11:31.718587 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-ee6539dc-c4ac-4986-9f3a-9c46123a3999 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.643290 Jul 25 23:11:31.719229 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 408/818] 10.222.0.55 () {60 vars in 1147 bytes} [Mon Jul 25 23:11:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 23:11:31.738219 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f0192c3d-f207-4e52-b1fd-8008219bf1c9 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:31.741429 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f0192c3d-f207-4e52-b1fd-8008219bf1c9 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] [instance: 57d8ce25-48a4-41be-9813-53386a25477c] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:31.828008 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f0192c3d-f207-4e52-b1fd-8008219bf1c9 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560c53f082994abdb68e8b7113fc5831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723890dbe52c422ba8347b7b842a0cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:31.835073 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f0192c3d-f207-4e52-b1fd-8008219bf1c9 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] 10.222.0.55 "GET /compute/v2.1/servers/57d8ce25-48a4-41be-9813-53386a25477c" status: 200 len: 1214 microversion: 2.1 time: 0.108403 Jul 25 23:11:31.835598 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 411/819] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:31 2022] GET /compute/v2.1/servers/57d8ce25-48a4-41be-9813-53386a25477c => generated 1214 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:11:32.856640 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-7ba044f5-cbf9-496e-9e8b-8708f3665d2f tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:32.858056 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-7ba044f5-cbf9-496e-9e8b-8708f3665d2f tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] [instance: 57d8ce25-48a4-41be-9813-53386a25477c] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:32.920930 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-7ba044f5-cbf9-496e-9e8b-8708f3665d2f tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560c53f082994abdb68e8b7113fc5831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723890dbe52c422ba8347b7b842a0cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:32.929601 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-7ba044f5-cbf9-496e-9e8b-8708f3665d2f tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] 10.222.0.55 "GET /compute/v2.1/servers/57d8ce25-48a4-41be-9813-53386a25477c" status: 200 len: 1214 microversion: 2.1 time: 0.077704 Jul 25 23:11:32.931048 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 409/820] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:32 2022] GET /compute/v2.1/servers/57d8ce25-48a4-41be-9813-53386a25477c => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:11:33.952061 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c603d505-e064-4a9a-9328-afb32e3482cc tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:33.952795 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c603d505-e064-4a9a-9328-afb32e3482cc tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] [instance: 57d8ce25-48a4-41be-9813-53386a25477c] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:33.960237 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c603d505-e064-4a9a-9328-afb32e3482cc tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:33.960906 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c603d505-e064-4a9a-9328-afb32e3482cc tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:33.962706 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c603d505-e064-4a9a-9328-afb32e3482cc tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:33.963310 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c603d505-e064-4a9a-9328-afb32e3482cc tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:34.041837 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c603d505-e064-4a9a-9328-afb32e3482cc tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560c53f082994abdb68e8b7113fc5831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723890dbe52c422ba8347b7b842a0cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:34.050611 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c603d505-e064-4a9a-9328-afb32e3482cc tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] 10.222.0.55 "GET /compute/v2.1/servers/57d8ce25-48a4-41be-9813-53386a25477c" status: 200 len: 1266 microversion: 2.1 time: 0.102271 Jul 25 23:11:34.051325 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 412/821] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:33 2022] GET /compute/v2.1/servers/57d8ce25-48a4-41be-9813-53386a25477c => generated 1266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:11:35.073198 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-938d05ce-e39c-4661-9884-b6729a9e2d9a tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:35.074596 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-938d05ce-e39c-4661-9884-b6729a9e2d9a tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] [instance: 57d8ce25-48a4-41be-9813-53386a25477c] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:35.088607 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-938d05ce-e39c-4661-9884-b6729a9e2d9a tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:35.088607 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-938d05ce-e39c-4661-9884-b6729a9e2d9a tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:35.088607 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-938d05ce-e39c-4661-9884-b6729a9e2d9a tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:35.088607 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-938d05ce-e39c-4661-9884-b6729a9e2d9a tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:35.276937 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-938d05ce-e39c-4661-9884-b6729a9e2d9a tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560c53f082994abdb68e8b7113fc5831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723890dbe52c422ba8347b7b842a0cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:35.284630 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-938d05ce-e39c-4661-9884-b6729a9e2d9a tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] 10.222.0.55 "GET /compute/v2.1/servers/57d8ce25-48a4-41be-9813-53386a25477c" status: 200 len: 1314 microversion: 2.1 time: 0.216534 Jul 25 23:11:35.285546 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 410/822] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:35 2022] GET /compute/v2.1/servers/57d8ce25-48a4-41be-9813-53386a25477c => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:11:36.010123 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-10d63069-6de0-472e-97b1-30cdb3a45832 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Action: 'create', calling method: .version_select at 0x7f6226dd7430>, body: {"keypair": {"name": "tempest-keypair-344773280", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIN56nHITQBOZzMiLjOUsKn3QRqdEIRsBJIZ6rz+z7MAoRSsg2GecgSZfPsr7bK0rJIFFBreoowIDhd93W0NM65iqlIcb+uNmMkvNb8VBsSyG3xkW/yoJVS2jtah54kg2w=="}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:11:36.027110 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-10d63069-6de0-472e-97b1-30cdb3a45832 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Getting quotas for project bca196a6befb4fae9531dc96a1e58d5f. Resources: {'key_pairs'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 23:11:36.032588 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-10d63069-6de0-472e-97b1-30cdb3a45832 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Getting quotas for user f54ad4a554de414a80ed03d62c1eb3a5 and project bca196a6befb4fae9531dc96a1e58d5f. Resources: {'key_pairs'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 23:11:36.114600 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-10d63069-6de0-472e-97b1-30cdb3a45832 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.244163 Jul 25 23:11:36.115207 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 413/823] 10.222.0.55 () {60 vars in 1159 bytes} [Mon Jul 25 23:11:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:11:36.201146 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-be558540-ad68-42e5-b830-0b4b17291251 req-28cf2d31-752b-40a6-87fa-e7a89f82934a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57d8ce25-48a4-41be-9813-53386a25477c", "tag": "1423814c-c760-4605-b182-4ce695612a0c"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:11:36.215072 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-be558540-ad68-42e5-b830-0b4b17291251 req-28cf2d31-752b-40a6-87fa-e7a89f82934a service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:36.215711 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-be558540-ad68-42e5-b830-0b4b17291251 req-28cf2d31-752b-40a6-87fa-e7a89f82934a service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:36.240292 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-be558540-ad68-42e5-b830-0b4b17291251 req-28cf2d31-752b-40a6-87fa-e7a89f82934a service nova] Creating event network-changed:1423814c-c760-4605-b182-4ce695612a0c for instance 57d8ce25-48a4-41be-9813-53386a25477c on hv-cinder-79760 Jul 25 23:11:36.249721 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-be558540-ad68-42e5-b830-0b4b17291251 req-28cf2d31-752b-40a6-87fa-e7a89f82934a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051734 Jul 25 23:11:36.251556 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 411/824] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:11:36.312591 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6867b5cc-acd2-427e-96d4-d3bc295a0cb0 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:36.313601 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6867b5cc-acd2-427e-96d4-d3bc295a0cb0 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] [instance: 57d8ce25-48a4-41be-9813-53386a25477c] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:36.327897 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6867b5cc-acd2-427e-96d4-d3bc295a0cb0 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:36.328606 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6867b5cc-acd2-427e-96d4-d3bc295a0cb0 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:36.329622 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6867b5cc-acd2-427e-96d4-d3bc295a0cb0 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:36.332453 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6867b5cc-acd2-427e-96d4-d3bc295a0cb0 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:36.535301 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6867b5cc-acd2-427e-96d4-d3bc295a0cb0 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560c53f082994abdb68e8b7113fc5831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723890dbe52c422ba8347b7b842a0cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:36.544425 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6867b5cc-acd2-427e-96d4-d3bc295a0cb0 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] 10.222.0.55 "GET /compute/v2.1/servers/57d8ce25-48a4-41be-9813-53386a25477c" status: 200 len: 1314 microversion: 2.1 time: 0.235617 Jul 25 23:11:36.545001 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 414/825] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:36 2022] GET /compute/v2.1/servers/57d8ce25-48a4-41be-9813-53386a25477c => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:11:37.567654 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-2749b853-4d8c-421d-a8ee-c14a0741cf9b tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:37.568345 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-2749b853-4d8c-421d-a8ee-c14a0741cf9b tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] [instance: 57d8ce25-48a4-41be-9813-53386a25477c] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:37.575565 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2749b853-4d8c-421d-a8ee-c14a0741cf9b tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:37.576015 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2749b853-4d8c-421d-a8ee-c14a0741cf9b tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:37.576811 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2749b853-4d8c-421d-a8ee-c14a0741cf9b tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:37.577258 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2749b853-4d8c-421d-a8ee-c14a0741cf9b tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:37.780200 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-2749b853-4d8c-421d-a8ee-c14a0741cf9b tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560c53f082994abdb68e8b7113fc5831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723890dbe52c422ba8347b7b842a0cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:37.788165 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-2749b853-4d8c-421d-a8ee-c14a0741cf9b tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] 10.222.0.55 "GET /compute/v2.1/servers/57d8ce25-48a4-41be-9813-53386a25477c" status: 200 len: 1314 microversion: 2.1 time: 0.225094 Jul 25 23:11:37.792751 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 412/826] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:37 2022] GET /compute/v2.1/servers/57d8ce25-48a4-41be-9813-53386a25477c => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:11:38.811649 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-fb549b01-7eff-4786-9562-12e4a1d03c0f tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:38.814431 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-fb549b01-7eff-4786-9562-12e4a1d03c0f tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] [instance: 57d8ce25-48a4-41be-9813-53386a25477c] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:38.821083 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fb549b01-7eff-4786-9562-12e4a1d03c0f tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:38.821895 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fb549b01-7eff-4786-9562-12e4a1d03c0f tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:38.822911 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fb549b01-7eff-4786-9562-12e4a1d03c0f tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:38.823356 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fb549b01-7eff-4786-9562-12e4a1d03c0f tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:39.057683 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-fb549b01-7eff-4786-9562-12e4a1d03c0f tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560c53f082994abdb68e8b7113fc5831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723890dbe52c422ba8347b7b842a0cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:39.065570 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-fb549b01-7eff-4786-9562-12e4a1d03c0f tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] 10.222.0.55 "GET /compute/v2.1/servers/57d8ce25-48a4-41be-9813-53386a25477c" status: 200 len: 1314 microversion: 2.1 time: 0.258957 Jul 25 23:11:39.066151 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 415/827] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:38 2022] GET /compute/v2.1/servers/57d8ce25-48a4-41be-9813-53386a25477c => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:11:39.129221 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-4fc71f4f-630f-48fd-8b78-2fd0209746f7 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-638483667", "imageRef": "8e9f3265-0fdf-483a-8e2e-41d408f5f0e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "61b90c6f-f28d-4718-a9dc-fcf196e75d09"}], "security_groups": [{"name": "tempest-securitygroup--2004999102"}], "key_name": "tempest-keypair-344773280", "user_data": "}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:11:39.241023 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.network.neutron [None req-4fc71f4f-630f-48fd-8b78-2fd0209746f7 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] validate_networks() for [('61b90c6f-f28d-4718-a9dc-fcf196e75d09', None, None, None, None, None)] {{(pid=118409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 23:11:39.643994 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-4fc71f4f-630f-48fd-8b78-2fd0209746f7 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Flavor limits 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 23:11:39.649355 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-4fc71f4f-630f-48fd-8b78-2fd0209746f7 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Image limits 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 23:11:39.649355 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-4fc71f4f-630f-48fd-8b78-2fd0209746f7 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Flavor pref 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 23:11:39.649355 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-4fc71f4f-630f-48fd-8b78-2fd0209746f7 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Image pref 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 23:11:39.649355 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-4fc71f4f-630f-48fd-8b78-2fd0209746f7 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 23:11:39.657385 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4fc71f4f-630f-48fd-8b78-2fd0209746f7 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:39.657822 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4fc71f4f-630f-48fd-8b78-2fd0209746f7 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:39.658726 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4fc71f4f-630f-48fd-8b78-2fd0209746f7 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:39.659153 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4fc71f4f-630f-48fd-8b78-2fd0209746f7 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:39.677590 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-4fc71f4f-630f-48fd-8b78-2fd0209746f7 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Getting quotas for project bca196a6befb4fae9531dc96a1e58d5f. Resources: {'instances', 'cores', 'ram'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 23:11:39.682544 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-4fc71f4f-630f-48fd-8b78-2fd0209746f7 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Getting quotas for user f54ad4a554de414a80ed03d62c1eb3a5 and project bca196a6befb4fae9531dc96a1e58d5f. Resources: {'instances', 'cores', 'ram'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 23:11:39.694752 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-4fc71f4f-630f-48fd-8b78-2fd0209746f7 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Going to run 1 instances... {{(pid=118409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 23:11:39.697248 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-4fc71f4f-630f-48fd-8b78-2fd0209746f7 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e9f3265-0fdf-483a-8e2e-41d408f5f0e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 23:11:39.858238 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-4fc71f4f-630f-48fd-8b78-2fd0209746f7 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.733298 Jul 25 23:11:39.859035 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 413/828] 10.222.0.55 () {60 vars in 1147 bytes} [Mon Jul 25 23:11:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 23:11:39.870396 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-34a349a9-bb6b-4a6b-8cba-6a5d6b58b75e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:39.870983 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-34a349a9-bb6b-4a6b-8cba-6a5d6b58b75e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:39.933361 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-34a349a9-bb6b-4a6b-8cba-6a5d6b58b75e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:39.940582 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-34a349a9-bb6b-4a6b-8cba-6a5d6b58b75e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf" status: 200 len: 1240 microversion: 2.1 time: 0.074652 Jul 25 23:11:39.941171 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 416/829] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:39 2022] GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf => generated 1240 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:11:40.088521 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-f5e68484-b179-4adc-a5dc-d5a357f222a3 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:40.089186 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-f5e68484-b179-4adc-a5dc-d5a357f222a3 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] [instance: 57d8ce25-48a4-41be-9813-53386a25477c] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:40.095504 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f5e68484-b179-4adc-a5dc-d5a357f222a3 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:40.095939 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f5e68484-b179-4adc-a5dc-d5a357f222a3 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:40.096702 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f5e68484-b179-4adc-a5dc-d5a357f222a3 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:40.097160 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f5e68484-b179-4adc-a5dc-d5a357f222a3 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:40.237648 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-f5e68484-b179-4adc-a5dc-d5a357f222a3 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560c53f082994abdb68e8b7113fc5831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723890dbe52c422ba8347b7b842a0cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:40.245934 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-f5e68484-b179-4adc-a5dc-d5a357f222a3 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] 10.222.0.55 "GET /compute/v2.1/servers/57d8ce25-48a4-41be-9813-53386a25477c" status: 200 len: 1314 microversion: 2.1 time: 0.162124 Jul 25 23:11:40.246528 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 414/830] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:40 2022] GET /compute/v2.1/servers/57d8ce25-48a4-41be-9813-53386a25477c => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:11:40.566843 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-a930d4f6-bc0d-4b97-80e4-34e845fe549a req-218c6395-d4d6-4f78-92b6-5014285a216b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57d8ce25-48a4-41be-9813-53386a25477c", "name": "network-vif-plugged", "status": "completed", "tag": "1423814c-c760-4605-b182-4ce695612a0c"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:11:40.578061 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-a930d4f6-bc0d-4b97-80e4-34e845fe549a req-218c6395-d4d6-4f78-92b6-5014285a216b service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:40.578591 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-a930d4f6-bc0d-4b97-80e4-34e845fe549a req-218c6395-d4d6-4f78-92b6-5014285a216b service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:40.590318 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-a930d4f6-bc0d-4b97-80e4-34e845fe549a req-218c6395-d4d6-4f78-92b6-5014285a216b service nova] Creating event network-vif-plugged:1423814c-c760-4605-b182-4ce695612a0c for instance 57d8ce25-48a4-41be-9813-53386a25477c on hv-cinder-79760 Jul 25 23:11:40.595614 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-a930d4f6-bc0d-4b97-80e4-34e845fe549a req-218c6395-d4d6-4f78-92b6-5014285a216b service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032429 Jul 25 23:11:40.596544 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 417/831] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:11:40.962528 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-d0db3ccc-4f39-45ef-8e03-e448c98132ed tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:40.963135 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-d0db3ccc-4f39-45ef-8e03-e448c98132ed tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:40.969101 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d0db3ccc-4f39-45ef-8e03-e448c98132ed tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:40.969587 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d0db3ccc-4f39-45ef-8e03-e448c98132ed tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:40.970349 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d0db3ccc-4f39-45ef-8e03-e448c98132ed tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:40.970843 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d0db3ccc-4f39-45ef-8e03-e448c98132ed tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:41.037143 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-d0db3ccc-4f39-45ef-8e03-e448c98132ed tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:41.042801 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-d0db3ccc-4f39-45ef-8e03-e448c98132ed tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf" status: 200 len: 1244 microversion: 2.1 time: 0.084783 Jul 25 23:11:41.043437 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 415/832] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:40 2022] GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:11:41.268647 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4fdb2fc3-92ee-4ffd-a975-715e3e46387e tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:41.269700 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4fdb2fc3-92ee-4ffd-a975-715e3e46387e tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] [instance: 57d8ce25-48a4-41be-9813-53386a25477c] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:41.276609 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4fdb2fc3-92ee-4ffd-a975-715e3e46387e tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:41.276982 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4fdb2fc3-92ee-4ffd-a975-715e3e46387e tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:41.277774 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4fdb2fc3-92ee-4ffd-a975-715e3e46387e tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:41.278202 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4fdb2fc3-92ee-4ffd-a975-715e3e46387e tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:41.415236 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4fdb2fc3-92ee-4ffd-a975-715e3e46387e tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560c53f082994abdb68e8b7113fc5831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723890dbe52c422ba8347b7b842a0cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:41.422645 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4fdb2fc3-92ee-4ffd-a975-715e3e46387e tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] 10.222.0.55 "GET /compute/v2.1/servers/57d8ce25-48a4-41be-9813-53386a25477c" status: 200 len: 1314 microversion: 2.1 time: 0.158692 Jul 25 23:11:41.423207 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 418/833] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:41 2022] GET /compute/v2.1/servers/57d8ce25-48a4-41be-9813-53386a25477c => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:11:42.063962 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-d62cbb89-ab30-408f-96e4-adca86c6cbb7 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:42.064522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-d62cbb89-ab30-408f-96e4-adca86c6cbb7 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:42.072152 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d62cbb89-ab30-408f-96e4-adca86c6cbb7 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:42.072598 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d62cbb89-ab30-408f-96e4-adca86c6cbb7 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:42.073387 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d62cbb89-ab30-408f-96e4-adca86c6cbb7 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:42.073817 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d62cbb89-ab30-408f-96e4-adca86c6cbb7 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:42.139688 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-d62cbb89-ab30-408f-96e4-adca86c6cbb7 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:42.147482 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-d62cbb89-ab30-408f-96e4-adca86c6cbb7 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf" status: 200 len: 1292 microversion: 2.1 time: 0.087503 Jul 25 23:11:42.148049 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 416/834] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:42 2022] GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf => generated 1292 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:11:42.443818 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d8c54591-1fe1-41dc-8146-e5c827d9df87 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:42.444400 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-d8c54591-1fe1-41dc-8146-e5c827d9df87 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] [instance: 57d8ce25-48a4-41be-9813-53386a25477c] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:42.452108 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d8c54591-1fe1-41dc-8146-e5c827d9df87 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:42.452549 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d8c54591-1fe1-41dc-8146-e5c827d9df87 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:42.453357 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d8c54591-1fe1-41dc-8146-e5c827d9df87 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:42.453791 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d8c54591-1fe1-41dc-8146-e5c827d9df87 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:42.589167 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-d8c54591-1fe1-41dc-8146-e5c827d9df87 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560c53f082994abdb68e8b7113fc5831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723890dbe52c422ba8347b7b842a0cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:42.596860 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-d8c54591-1fe1-41dc-8146-e5c827d9df87 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] 10.222.0.55 "GET /compute/v2.1/servers/57d8ce25-48a4-41be-9813-53386a25477c" status: 200 len: 1498 microversion: 2.1 time: 0.156820 Jul 25 23:11:42.597333 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 419/835] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:42 2022] GET /compute/v2.1/servers/57d8ce25-48a4-41be-9813-53386a25477c => generated 1498 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:11:43.170798 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-858b83f7-a220-4b3e-a3ff-2896732e8922 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:43.171825 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-858b83f7-a220-4b3e-a3ff-2896732e8922 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:43.179460 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-858b83f7-a220-4b3e-a3ff-2896732e8922 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:43.179934 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-858b83f7-a220-4b3e-a3ff-2896732e8922 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:43.180780 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-858b83f7-a220-4b3e-a3ff-2896732e8922 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:43.181308 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-858b83f7-a220-4b3e-a3ff-2896732e8922 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:43.258101 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-858b83f7-a220-4b3e-a3ff-2896732e8922 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:43.265632 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-858b83f7-a220-4b3e-a3ff-2896732e8922 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf" status: 200 len: 1300 microversion: 2.1 time: 0.099279 Jul 25 23:11:43.266205 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 417/836] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:43 2022] GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf => generated 1300 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:11:43.453710 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-70958670-0fe4-4ebe-bed5-a862f1c98395 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:43.454319 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-70958670-0fe4-4ebe-bed5-a862f1c98395 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] [instance: 57d8ce25-48a4-41be-9813-53386a25477c] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:43.461966 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-70958670-0fe4-4ebe-bed5-a862f1c98395 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:43.462497 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-70958670-0fe4-4ebe-bed5-a862f1c98395 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:43.463351 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-70958670-0fe4-4ebe-bed5-a862f1c98395 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:43.463858 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-70958670-0fe4-4ebe-bed5-a862f1c98395 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:43.491615 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-70958670-0fe4-4ebe-bed5-a862f1c98395 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] [instance: 57d8ce25-48a4-41be-9813-53386a25477c] Going to try to terminate instance {{(pid=118410) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 23:11:43.784462 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-70958670-0fe4-4ebe-bed5-a862f1c98395 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] 10.222.0.55 "DELETE /compute/v2.1/servers/57d8ce25-48a4-41be-9813-53386a25477c" status: 204 len: 0 microversion: 2.1 time: 0.334516 Jul 25 23:11:43.785082 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 420/837] 10.222.0.55 () {58 vars in 1239 bytes} [Mon Jul 25 23:11:43 2022] DELETE /compute/v2.1/servers/57d8ce25-48a4-41be-9813-53386a25477c => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 23:11:43.794257 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-87703b0a-6ad5-422c-845a-68fced3c505f tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:43.794851 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-87703b0a-6ad5-422c-845a-68fced3c505f tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] [instance: 57d8ce25-48a4-41be-9813-53386a25477c] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:43.800841 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-87703b0a-6ad5-422c-845a-68fced3c505f tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:43.801317 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-87703b0a-6ad5-422c-845a-68fced3c505f tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:43.802065 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-87703b0a-6ad5-422c-845a-68fced3c505f tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:43.802490 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-87703b0a-6ad5-422c-845a-68fced3c505f tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:43.948270 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-87703b0a-6ad5-422c-845a-68fced3c505f tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560c53f082994abdb68e8b7113fc5831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723890dbe52c422ba8347b7b842a0cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:43.956495 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-87703b0a-6ad5-422c-845a-68fced3c505f tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] 10.222.0.55 "GET /compute/v2.1/servers/57d8ce25-48a4-41be-9813-53386a25477c" status: 200 len: 1504 microversion: 2.1 time: 0.166893 Jul 25 23:11:43.957077 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 418/838] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:43 2022] GET /compute/v2.1/servers/57d8ce25-48a4-41be-9813-53386a25477c => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:11:44.288469 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-2087cfd7-4eaf-41d1-8d2b-3008b8a16e99 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:44.289811 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-2087cfd7-4eaf-41d1-8d2b-3008b8a16e99 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:44.296019 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2087cfd7-4eaf-41d1-8d2b-3008b8a16e99 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:44.296470 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2087cfd7-4eaf-41d1-8d2b-3008b8a16e99 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:44.297526 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2087cfd7-4eaf-41d1-8d2b-3008b8a16e99 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:44.297905 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2087cfd7-4eaf-41d1-8d2b-3008b8a16e99 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:44.437110 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-2087cfd7-4eaf-41d1-8d2b-3008b8a16e99 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:44.444654 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-2087cfd7-4eaf-41d1-8d2b-3008b8a16e99 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf" status: 200 len: 1366 microversion: 2.1 time: 0.160521 Jul 25 23:11:44.445264 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 421/839] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:44 2022] GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:11:44.978757 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-58d1ec45-8a5a-4862-9f17-3316a6860436 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:44.979362 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-58d1ec45-8a5a-4862-9f17-3316a6860436 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] [instance: 57d8ce25-48a4-41be-9813-53386a25477c] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:44.985878 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-58d1ec45-8a5a-4862-9f17-3316a6860436 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:44.986332 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-58d1ec45-8a5a-4862-9f17-3316a6860436 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:44.987144 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-58d1ec45-8a5a-4862-9f17-3316a6860436 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:44.987532 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-58d1ec45-8a5a-4862-9f17-3316a6860436 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:45.123785 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-58d1ec45-8a5a-4862-9f17-3316a6860436 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560c53f082994abdb68e8b7113fc5831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723890dbe52c422ba8347b7b842a0cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:45.135337 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-58d1ec45-8a5a-4862-9f17-3316a6860436 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] 10.222.0.55 "GET /compute/v2.1/servers/57d8ce25-48a4-41be-9813-53386a25477c" status: 200 len: 1504 microversion: 2.1 time: 0.156518 Jul 25 23:11:45.135337 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 419/840] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:44 2022] GET /compute/v2.1/servers/57d8ce25-48a4-41be-9813-53386a25477c => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:11:45.469049 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b1e817ca-ae87-4104-9931-3c054a19c7fd tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:45.469663 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b1e817ca-ae87-4104-9931-3c054a19c7fd tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:45.478372 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b1e817ca-ae87-4104-9931-3c054a19c7fd tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:45.478819 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b1e817ca-ae87-4104-9931-3c054a19c7fd tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:45.480700 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b1e817ca-ae87-4104-9931-3c054a19c7fd tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:45.481232 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b1e817ca-ae87-4104-9931-3c054a19c7fd tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:45.693207 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b1e817ca-ae87-4104-9931-3c054a19c7fd tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:45.703354 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b1e817ca-ae87-4104-9931-3c054a19c7fd tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf" status: 200 len: 1366 microversion: 2.1 time: 0.239333 Jul 25 23:11:45.704031 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 422/841] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:45 2022] GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:11:45.718122 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-91714497-8171-488c-a5df-063c3e24bab2 req-871a693a-8b29-40ab-9875-369a72d8a28e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf", "tag": "b8685360-29d7-4321-89d9-cdb5d87c4964"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:11:45.733777 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-91714497-8171-488c-a5df-063c3e24bab2 req-871a693a-8b29-40ab-9875-369a72d8a28e service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:45.734699 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-91714497-8171-488c-a5df-063c3e24bab2 req-871a693a-8b29-40ab-9875-369a72d8a28e service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:45.948441 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-91714497-8171-488c-a5df-063c3e24bab2 req-871a693a-8b29-40ab-9875-369a72d8a28e service nova] Creating event network-changed:b8685360-29d7-4321-89d9-cdb5d87c4964 for instance d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf on hv-cinder-79760 Jul 25 23:11:45.948441 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-91714497-8171-488c-a5df-063c3e24bab2 req-871a693a-8b29-40ab-9875-369a72d8a28e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.236754 Jul 25 23:11:45.948441 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 420/842] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:11:46.004078 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-8f402a10-8bd4-40fc-a550-e082bc349214 req-68430a87-0234-4f07-beda-45efc3b20ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57d8ce25-48a4-41be-9813-53386a25477c", "name": "network-vif-deleted", "tag": "1423814c-c760-4605-b182-4ce695612a0c"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:11:46.015264 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-8f402a10-8bd4-40fc-a550-e082bc349214 req-68430a87-0234-4f07-beda-45efc3b20ee7 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:46.015711 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-8f402a10-8bd4-40fc-a550-e082bc349214 req-68430a87-0234-4f07-beda-45efc3b20ee7 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:46.026971 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-8f402a10-8bd4-40fc-a550-e082bc349214 req-68430a87-0234-4f07-beda-45efc3b20ee7 service nova] Creating event network-vif-deleted:1423814c-c760-4605-b182-4ce695612a0c for instance 57d8ce25-48a4-41be-9813-53386a25477c on hv-cinder-79760 Jul 25 23:11:46.031989 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-8f402a10-8bd4-40fc-a550-e082bc349214 req-68430a87-0234-4f07-beda-45efc3b20ee7 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089751 Jul 25 23:11:46.032584 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 423/843] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 23:11:46.153833 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-827eaaf3-f878-4000-b72b-37da2c69038e tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:46.154618 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-827eaaf3-f878-4000-b72b-37da2c69038e tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] [instance: 57d8ce25-48a4-41be-9813-53386a25477c] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:46.161255 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-827eaaf3-f878-4000-b72b-37da2c69038e tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:46.161698 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-827eaaf3-f878-4000-b72b-37da2c69038e tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:46.162490 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-827eaaf3-f878-4000-b72b-37da2c69038e tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:46.162921 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-827eaaf3-f878-4000-b72b-37da2c69038e tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:46.232277 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-827eaaf3-f878-4000-b72b-37da2c69038e tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560c53f082994abdb68e8b7113fc5831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723890dbe52c422ba8347b7b842a0cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:46.240152 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-827eaaf3-f878-4000-b72b-37da2c69038e tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] 10.222.0.55 "GET /compute/v2.1/servers/57d8ce25-48a4-41be-9813-53386a25477c" status: 200 len: 1299 microversion: 2.1 time: 0.090421 Jul 25 23:11:46.240722 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 421/844] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:46 2022] GET /compute/v2.1/servers/57d8ce25-48a4-41be-9813-53386a25477c => generated 1299 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:11:46.726141 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e759e494-3afc-4ba4-a2e9-22cea4fc0b6d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:46.727496 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e759e494-3afc-4ba4-a2e9-22cea4fc0b6d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:46.733868 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e759e494-3afc-4ba4-a2e9-22cea4fc0b6d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:46.734314 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e759e494-3afc-4ba4-a2e9-22cea4fc0b6d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:46.735074 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e759e494-3afc-4ba4-a2e9-22cea4fc0b6d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:46.735538 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e759e494-3afc-4ba4-a2e9-22cea4fc0b6d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:46.868489 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e759e494-3afc-4ba4-a2e9-22cea4fc0b6d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:46.876053 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e759e494-3afc-4ba4-a2e9-22cea4fc0b6d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf" status: 200 len: 1366 microversion: 2.1 time: 0.154737 Jul 25 23:11:46.876614 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 424/845] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:46 2022] GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:11:47.261984 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-e6c0d341-398d-4b1c-9f7a-1a7f13b2f30e tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:47.262517 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-e6c0d341-398d-4b1c-9f7a-1a7f13b2f30e tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] [instance: 57d8ce25-48a4-41be-9813-53386a25477c] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:47.269256 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e6c0d341-398d-4b1c-9f7a-1a7f13b2f30e tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:47.269717 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e6c0d341-398d-4b1c-9f7a-1a7f13b2f30e tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:47.270473 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e6c0d341-398d-4b1c-9f7a-1a7f13b2f30e tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:47.270897 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e6c0d341-398d-4b1c-9f7a-1a7f13b2f30e tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:47.274223 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:11:47.303184 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e6c0d341-398d-4b1c-9f7a-1a7f13b2f30e tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:47.303661 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e6c0d341-398d-4b1c-9f7a-1a7f13b2f30e tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:47.304123 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.objects.instance [None req-e6c0d341-398d-4b1c-9f7a-1a7f13b2f30e tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lazy-loading 'fault' on Instance uuid 57d8ce25-48a4-41be-9813-53386a25477c {{(pid=118409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 23:11:47.347031 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-e6c0d341-398d-4b1c-9f7a-1a7f13b2f30e tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560c53f082994abdb68e8b7113fc5831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723890dbe52c422ba8347b7b842a0cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:47.356096 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-e6c0d341-398d-4b1c-9f7a-1a7f13b2f30e tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] 10.222.0.55 "GET /compute/v2.1/servers/57d8ce25-48a4-41be-9813-53386a25477c" status: 200 len: 1304 microversion: 2.1 time: 0.098558 Jul 25 23:11:47.356872 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 422/846] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:47 2022] GET /compute/v2.1/servers/57d8ce25-48a4-41be-9813-53386a25477c => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:11:47.898937 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-259f427e-8474-4558-8281-2d31e905b030 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:47.899541 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-259f427e-8474-4558-8281-2d31e905b030 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:47.901937 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:11:47.906748 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-259f427e-8474-4558-8281-2d31e905b030 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:47.907191 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-259f427e-8474-4558-8281-2d31e905b030 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:47.907960 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-259f427e-8474-4558-8281-2d31e905b030 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:47.908388 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-259f427e-8474-4558-8281-2d31e905b030 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:47.911015 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:11:48.047790 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-259f427e-8474-4558-8281-2d31e905b030 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:48.056337 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-259f427e-8474-4558-8281-2d31e905b030 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf" status: 200 len: 1366 microversion: 2.1 time: 0.162094 Jul 25 23:11:48.056904 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 425/847] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:47 2022] GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:11:48.378918 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-919ca332-f375-43b7-a4d0-1a2c70f4bc90 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:48.379524 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-919ca332-f375-43b7-a4d0-1a2c70f4bc90 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] [instance: 57d8ce25-48a4-41be-9813-53386a25477c] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:48.382159 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:11:48.388102 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-919ca332-f375-43b7-a4d0-1a2c70f4bc90 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:48.388553 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-919ca332-f375-43b7-a4d0-1a2c70f4bc90 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:48.389424 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-919ca332-f375-43b7-a4d0-1a2c70f4bc90 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:48.389860 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-919ca332-f375-43b7-a4d0-1a2c70f4bc90 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:48.404401 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.wsgi [None req-919ca332-f375-43b7-a4d0-1a2c70f4bc90 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] HTTP exception thrown: Instance 57d8ce25-48a4-41be-9813-53386a25477c could not be found. Jul 25 23:11:48.406096 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-919ca332-f375-43b7-a4d0-1a2c70f4bc90 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Request method failure captured: Jul 25 23:11:48.406096 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: request: GET /compute/v2.1/servers/57d8ce25-48a4-41be-9813-53386a25477c HTTP/1.1 Jul 25 23:11:48.406096 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept: application/json Jul 25 23:11:48.406096 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept-Encoding: identity Jul 25 23:11:48.406096 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Connection: close Jul 25 23:11:48.406096 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Length: 0 Jul 25 23:11:48.406096 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Type: application/json Jul 25 23:11:48.406096 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Host: 10.222.0.55 Jul 25 23:11:48.406096 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Openstack-System-Scope: None Jul 25 23:11:48.406096 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: User-Agent: python-urllib3/1.26.10 Jul 25 23:11:48.406096 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Auth-Token: gAAAAABi3yMgyVRsRf-it71ypOxnfw0svQVT6SUTLDydNaJGYw0qLg5Qb35LNEk3rLKlFbVlNIL9Fufgr0x5fPVuhkldgFZ2IsIyLAPoVbhOQDzacPVLHezdaATkzlWn-jfGGtEIBPBkmqCrfH-LZUCTdW0kZOY4UAjDV1lL36wMOXdQ7Rd6to4 Jul 25 23:11:48.406096 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Id: None Jul 25 23:11:48.406096 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Name: None Jul 25 23:11:48.406096 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Identity-Status: Confirmed Jul 25 23:11:48.406096 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Is-Admin-Project: True Jul 25 23:11:48.406096 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Id: default Jul 25 23:11:48.406096 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Name: Default Jul 25 23:11:48.406096 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Id: 723890dbe52c422ba8347b7b842a0cd9 Jul 25 23:11:48.406096 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Name: tempest-VolumesActionsTest-98829762 Jul 25 23:11:48.406096 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Role: reader,member Jul 25 23:11:48.406096 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Roles: reader,member Jul 25 23:11:48.407853 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/723890dbe52c422ba8347b7b842a0cd9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/723890dbe52c422ba8347b7b842a0cd9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_723890dbe52c422ba8347b7b842a0cd9", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/723890dbe52c422ba8347b7b842a0cd9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:11:48.407853 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant: tempest-VolumesActionsTest-98829762 Jul 25 23:11:48.407853 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Id: 723890dbe52c422ba8347b7b842a0cd9 Jul 25 23:11:48.407853 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Name: tempest-VolumesActionsTest-98829762 Jul 25 23:11:48.407853 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User: tempest-VolumesActionsTest-98829762-project Jul 25 23:11:48.407853 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Id: default Jul 25 23:11:48.407853 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Name: Default Jul 25 23:11:48.407853 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Id: 560c53f082994abdb68e8b7113fc5831 Jul 25 23:11:48.407853 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Name: tempest-VolumesActionsTest-98829762-project Jul 25 23:11:48.407853 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: method: > Jul 25 23:11:48.407853 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: exception: Instance 57d8ce25-48a4-41be-9813-53386a25477c could not be found. Jul 25 23:11:48.407853 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: action_args: {'id': '57d8ce25-48a4-41be-9813-53386a25477c'} Jul 25 23:11:48.408799 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:11:48.408799 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:11:48.408799 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:11:48.408799 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:11:48.408799 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:11:48.408799 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:11:48.408799 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:11:48.408799 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:11:48.408799 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:11:48.408799 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:11:48.408799 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57d8ce25-48a4-41be-9813-53386a25477c could not be found. Jul 25 23:11:48.408799 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:11:48.408799 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:11:48.408799 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:11:48.408799 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:11:48.408799 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:11:48.408799 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:11:48.408799 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:11:48.408799 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:11:48.408799 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:11:48.410254 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:11:48.410254 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 23:11:48.410254 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 23:11:48.410254 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:11:48.410254 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:11:48.410254 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:11:48.410254 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:11:48.410254 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57d8ce25-48a4-41be-9813-53386a25477c could not be found. Jul 25 23:11:48.410254 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:11:48.410254 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:11:48.410254 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:11:48.410254 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:11:48.410254 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:11:48.410254 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:11:48.410254 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:11:48.410254 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:11:48.410254 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57d8ce25-48a4-41be-9813-53386a25477c could not be found. Jul 25 23:11:48.410254 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:11:48.411464 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-919ca332-f375-43b7-a4d0-1a2c70f4bc90 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Returning 404 to user: Instance 57d8ce25-48a4-41be-9813-53386a25477c could not be found. {{(pid=118409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:11:48.411464 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-919ca332-f375-43b7-a4d0-1a2c70f4bc90 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] 10.222.0.55 "GET /compute/v2.1/servers/57d8ce25-48a4-41be-9813-53386a25477c" status: 404 len: 111 microversion: 2.1 time: 0.032460 Jul 25 23:11:48.412097 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 423/848] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:48 2022] GET /compute/v2.1/servers/57d8ce25-48a4-41be-9813-53386a25477c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:11:48.458863 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d13e9c15-bb96-4e76-94ef-46cca70cb18d tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-185962768", "imageRef": "8e9f3265-0fdf-483a-8e2e-41d408f5f0e7", "flavorRef": "452", "networks": [{"uuid": "ec47b4be-bddf-4a70-a6d5-ad18a4d61efa"}]}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:11:48.513860 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.network.neutron [None req-d13e9c15-bb96-4e76-94ef-46cca70cb18d tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] validate_networks() for [('ec47b4be-bddf-4a70-a6d5-ad18a4d61efa', None, None, None, None, None)] {{(pid=118410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 23:11:48.924378 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-d13e9c15-bb96-4e76-94ef-46cca70cb18d tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Flavor limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 23:11:48.924953 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-d13e9c15-bb96-4e76-94ef-46cca70cb18d tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Image limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 23:11:48.925297 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-d13e9c15-bb96-4e76-94ef-46cca70cb18d tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Flavor pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 23:11:48.926052 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-d13e9c15-bb96-4e76-94ef-46cca70cb18d tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Image pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 23:11:48.926467 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-d13e9c15-bb96-4e76-94ef-46cca70cb18d tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 23:11:48.936226 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d13e9c15-bb96-4e76-94ef-46cca70cb18d tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:48.936671 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d13e9c15-bb96-4e76-94ef-46cca70cb18d tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:48.937511 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d13e9c15-bb96-4e76-94ef-46cca70cb18d tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:48.937941 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d13e9c15-bb96-4e76-94ef-46cca70cb18d tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:48.954680 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-d13e9c15-bb96-4e76-94ef-46cca70cb18d tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Getting quotas for project 723890dbe52c422ba8347b7b842a0cd9. Resources: {'instances', 'cores', 'ram'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 23:11:48.958547 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-d13e9c15-bb96-4e76-94ef-46cca70cb18d tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Getting quotas for user 560c53f082994abdb68e8b7113fc5831 and project 723890dbe52c422ba8347b7b842a0cd9. Resources: {'instances', 'cores', 'ram'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 23:11:48.970016 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-d13e9c15-bb96-4e76-94ef-46cca70cb18d tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Going to run 1 instances... {{(pid=118410) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 23:11:48.972299 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-d13e9c15-bb96-4e76-94ef-46cca70cb18d tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] [instance: a4fecbfb-c721-4ce2-a76a-4c7cf37297c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e9f3265-0fdf-483a-8e2e-41d408f5f0e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 23:11:49.062316 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-d13e9c15-bb96-4e76-94ef-46cca70cb18d tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607589 Jul 25 23:11:49.062855 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 426/849] 10.222.0.55 () {60 vars in 1147 bytes} [Mon Jul 25 23:11:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 23:11:49.073745 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-cf750b7b-7468-47ac-9e4e-78af9975b831 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:49.074597 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-cf750b7b-7468-47ac-9e4e-78af9975b831 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] [instance: a4fecbfb-c721-4ce2-a76a-4c7cf37297c4] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:49.078574 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-17e14bca-288e-44d3-968b-b97e468029e5 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:49.079207 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-17e14bca-288e-44d3-968b-b97e468029e5 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:49.089650 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-17e14bca-288e-44d3-968b-b97e468029e5 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:49.090103 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-17e14bca-288e-44d3-968b-b97e468029e5 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:49.090883 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-17e14bca-288e-44d3-968b-b97e468029e5 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:49.091338 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-17e14bca-288e-44d3-968b-b97e468029e5 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:49.135086 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-cf750b7b-7468-47ac-9e4e-78af9975b831 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560c53f082994abdb68e8b7113fc5831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723890dbe52c422ba8347b7b842a0cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:49.142395 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-cf750b7b-7468-47ac-9e4e-78af9975b831 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] 10.222.0.55 "GET /compute/v2.1/servers/a4fecbfb-c721-4ce2-a76a-4c7cf37297c4" status: 200 len: 1213 microversion: 2.1 time: 0.072520 Jul 25 23:11:49.143046 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 424/850] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:49 2022] GET /compute/v2.1/servers/a4fecbfb-c721-4ce2-a76a-4c7cf37297c4 => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:11:49.232912 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-17e14bca-288e-44d3-968b-b97e468029e5 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:49.240489 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-17e14bca-288e-44d3-968b-b97e468029e5 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf" status: 200 len: 1366 microversion: 2.1 time: 0.166723 Jul 25 23:11:49.241050 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 427/851] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:49 2022] GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:11:50.164641 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-677f9294-3cc6-4b74-b1f9-95deb366c217 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:50.166265 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-677f9294-3cc6-4b74-b1f9-95deb366c217 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] [instance: a4fecbfb-c721-4ce2-a76a-4c7cf37297c4] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:50.167652 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell0:SELECT=4 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:11:50.173331 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-677f9294-3cc6-4b74-b1f9-95deb366c217 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:50.173773 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-677f9294-3cc6-4b74-b1f9-95deb366c217 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:50.174520 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-677f9294-3cc6-4b74-b1f9-95deb366c217 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:50.174997 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-677f9294-3cc6-4b74-b1f9-95deb366c217 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:50.241392 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-677f9294-3cc6-4b74-b1f9-95deb366c217 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560c53f082994abdb68e8b7113fc5831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723890dbe52c422ba8347b7b842a0cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:50.250471 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-677f9294-3cc6-4b74-b1f9-95deb366c217 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] 10.222.0.55 "GET /compute/v2.1/servers/a4fecbfb-c721-4ce2-a76a-4c7cf37297c4" status: 200 len: 1217 microversion: 2.1 time: 0.090504 Jul 25 23:11:50.251049 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 425/852] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:50 2022] GET /compute/v2.1/servers/a4fecbfb-c721-4ce2-a76a-4c7cf37297c4 => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:11:50.262365 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-15864ef9-e4ef-4be8-9d60-0e1a80cbf812 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:50.262934 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-15864ef9-e4ef-4be8-9d60-0e1a80cbf812 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:50.269758 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-15864ef9-e4ef-4be8-9d60-0e1a80cbf812 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:50.270209 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-15864ef9-e4ef-4be8-9d60-0e1a80cbf812 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:50.270988 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-15864ef9-e4ef-4be8-9d60-0e1a80cbf812 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:50.271434 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-15864ef9-e4ef-4be8-9d60-0e1a80cbf812 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:50.417658 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-15864ef9-e4ef-4be8-9d60-0e1a80cbf812 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:50.426562 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-15864ef9-e4ef-4be8-9d60-0e1a80cbf812 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf" status: 200 len: 1366 microversion: 2.1 time: 0.168514 Jul 25 23:11:50.427180 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 428/853] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:50 2022] GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:11:50.488288 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-343d6cbd-0a4a-4d03-9b07-c821e83afbb3 req-6ef3c89a-5ef7-48b2-9114-8d4c73fd2fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf", "name": "network-vif-plugged", "status": "completed", "tag": "b8685360-29d7-4321-89d9-cdb5d87c4964"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:11:50.497992 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-343d6cbd-0a4a-4d03-9b07-c821e83afbb3 req-6ef3c89a-5ef7-48b2-9114-8d4c73fd2fb0 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:50.498444 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-343d6cbd-0a4a-4d03-9b07-c821e83afbb3 req-6ef3c89a-5ef7-48b2-9114-8d4c73fd2fb0 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:50.509577 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-343d6cbd-0a4a-4d03-9b07-c821e83afbb3 req-6ef3c89a-5ef7-48b2-9114-8d4c73fd2fb0 service nova] Creating event network-vif-plugged:b8685360-29d7-4321-89d9-cdb5d87c4964 for instance d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf on hv-cinder-79760 Jul 25 23:11:50.514392 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-343d6cbd-0a4a-4d03-9b07-c821e83afbb3 req-6ef3c89a-5ef7-48b2-9114-8d4c73fd2fb0 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030043 Jul 25 23:11:50.514967 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 426/854] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:11:51.273059 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a364f660-fe50-42cc-b272-e9bf8edb96fb tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:51.273821 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a364f660-fe50-42cc-b272-e9bf8edb96fb tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] [instance: a4fecbfb-c721-4ce2-a76a-4c7cf37297c4] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:51.282239 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a364f660-fe50-42cc-b272-e9bf8edb96fb tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:51.282692 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a364f660-fe50-42cc-b272-e9bf8edb96fb tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:51.283503 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a364f660-fe50-42cc-b272-e9bf8edb96fb tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:51.283938 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a364f660-fe50-42cc-b272-e9bf8edb96fb tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:51.346534 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a364f660-fe50-42cc-b272-e9bf8edb96fb tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560c53f082994abdb68e8b7113fc5831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723890dbe52c422ba8347b7b842a0cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:51.354167 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a364f660-fe50-42cc-b272-e9bf8edb96fb tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] 10.222.0.55 "GET /compute/v2.1/servers/a4fecbfb-c721-4ce2-a76a-4c7cf37297c4" status: 200 len: 1273 microversion: 2.1 time: 0.085222 Jul 25 23:11:51.354732 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 429/855] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:51 2022] GET /compute/v2.1/servers/a4fecbfb-c721-4ce2-a76a-4c7cf37297c4 => generated 1273 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:11:51.449442 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-ead808b4-7881-4e4d-884d-943da2002d60 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:51.450059 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-ead808b4-7881-4e4d-884d-943da2002d60 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:51.456856 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ead808b4-7881-4e4d-884d-943da2002d60 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:51.457340 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ead808b4-7881-4e4d-884d-943da2002d60 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:51.458107 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ead808b4-7881-4e4d-884d-943da2002d60 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:51.458542 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ead808b4-7881-4e4d-884d-943da2002d60 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:51.671826 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-ead808b4-7881-4e4d-884d-943da2002d60 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:51.679413 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-ead808b4-7881-4e4d-884d-943da2002d60 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf" status: 200 len: 1366 microversion: 2.1 time: 0.234595 Jul 25 23:11:51.680800 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 427/856] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:51 2022] GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:11:52.375469 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-9d485ae2-554e-4e5c-b0f4-a362140061a7 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:52.376387 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-9d485ae2-554e-4e5c-b0f4-a362140061a7 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] [instance: a4fecbfb-c721-4ce2-a76a-4c7cf37297c4] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:52.383621 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9d485ae2-554e-4e5c-b0f4-a362140061a7 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:52.384210 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9d485ae2-554e-4e5c-b0f4-a362140061a7 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:52.385016 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9d485ae2-554e-4e5c-b0f4-a362140061a7 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:52.385552 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9d485ae2-554e-4e5c-b0f4-a362140061a7 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:52.520177 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9d485ae2-554e-4e5c-b0f4-a362140061a7 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560c53f082994abdb68e8b7113fc5831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723890dbe52c422ba8347b7b842a0cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:52.528468 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-9d485ae2-554e-4e5c-b0f4-a362140061a7 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] 10.222.0.55 "GET /compute/v2.1/servers/a4fecbfb-c721-4ce2-a76a-4c7cf37297c4" status: 200 len: 1313 microversion: 2.1 time: 0.156922 Jul 25 23:11:52.529027 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 430/857] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:52 2022] GET /compute/v2.1/servers/a4fecbfb-c721-4ce2-a76a-4c7cf37297c4 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:11:52.702175 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-98ba5252-c31c-49fe-b3a2-8093e84cbb7c tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:52.702786 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-98ba5252-c31c-49fe-b3a2-8093e84cbb7c tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:52.709655 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-98ba5252-c31c-49fe-b3a2-8093e84cbb7c tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:52.710187 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-98ba5252-c31c-49fe-b3a2-8093e84cbb7c tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:52.711592 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-98ba5252-c31c-49fe-b3a2-8093e84cbb7c tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:52.712055 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-98ba5252-c31c-49fe-b3a2-8093e84cbb7c tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:52.968874 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-98ba5252-c31c-49fe-b3a2-8093e84cbb7c tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:52.976428 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-98ba5252-c31c-49fe-b3a2-8093e84cbb7c tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf" status: 200 len: 1555 microversion: 2.1 time: 0.278271 Jul 25 23:11:52.977216 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 428/858] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:52 2022] GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf => generated 1555 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:11:52.997492 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-3d8cd59e-c548-4dcf-8459-aeb058e6b57d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:52.997992 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-3d8cd59e-c548-4dcf-8459-aeb058e6b57d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:53.004093 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3d8cd59e-c548-4dcf-8459-aeb058e6b57d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:53.004547 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3d8cd59e-c548-4dcf-8459-aeb058e6b57d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:53.005345 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3d8cd59e-c548-4dcf-8459-aeb058e6b57d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:53.005783 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3d8cd59e-c548-4dcf-8459-aeb058e6b57d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:53.098753 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-3d8cd59e-c548-4dcf-8459-aeb058e6b57d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105127 Jul 25 23:11:53.099345 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 431/859] 10.222.0.55 () {58 vars in 1275 bytes} [Mon Jul 25 23:11:52 2022] GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 23:11:53.548839 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-f3dbfe66-51c1-409e-9762-7ecb307dfe65 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:53.549477 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-f3dbfe66-51c1-409e-9762-7ecb307dfe65 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] [instance: a4fecbfb-c721-4ce2-a76a-4c7cf37297c4] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:53.556338 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f3dbfe66-51c1-409e-9762-7ecb307dfe65 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:53.556847 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f3dbfe66-51c1-409e-9762-7ecb307dfe65 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:53.557683 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f3dbfe66-51c1-409e-9762-7ecb307dfe65 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:53.558115 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f3dbfe66-51c1-409e-9762-7ecb307dfe65 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:53.786167 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-f3dbfe66-51c1-409e-9762-7ecb307dfe65 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560c53f082994abdb68e8b7113fc5831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723890dbe52c422ba8347b7b842a0cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:53.794512 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-f3dbfe66-51c1-409e-9762-7ecb307dfe65 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] 10.222.0.55 "GET /compute/v2.1/servers/a4fecbfb-c721-4ce2-a76a-4c7cf37297c4" status: 200 len: 1313 microversion: 2.1 time: 0.249625 Jul 25 23:11:53.795073 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 429/860] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:53 2022] GET /compute/v2.1/servers/a4fecbfb-c721-4ce2-a76a-4c7cf37297c4 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:11:53.880997 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-130c5c46-f502-4eb1-9caa-37bab5aa1d11 req-70499225-1cfc-4ec4-8f28-40257e3562e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4fecbfb-c721-4ce2-a76a-4c7cf37297c4", "tag": "1c1fd5f8-b8a8-4115-9cf4-9b35a3a972c6"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:11:53.892191 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-130c5c46-f502-4eb1-9caa-37bab5aa1d11 req-70499225-1cfc-4ec4-8f28-40257e3562e3 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:53.893694 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-130c5c46-f502-4eb1-9caa-37bab5aa1d11 req-70499225-1cfc-4ec4-8f28-40257e3562e3 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:53.905157 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-130c5c46-f502-4eb1-9caa-37bab5aa1d11 req-70499225-1cfc-4ec4-8f28-40257e3562e3 service nova] Creating event network-changed:1c1fd5f8-b8a8-4115-9cf4-9b35a3a972c6 for instance a4fecbfb-c721-4ce2-a76a-4c7cf37297c4 on hv-cinder-79760 Jul 25 23:11:53.910235 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-130c5c46-f502-4eb1-9caa-37bab5aa1d11 req-70499225-1cfc-4ec4-8f28-40257e3562e3 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033499 Jul 25 23:11:53.911333 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 432/861] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:11:54.816143 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-5860e65c-f5b7-416c-8139-bdf2ad5c5250 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:54.818565 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-5860e65c-f5b7-416c-8139-bdf2ad5c5250 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] [instance: a4fecbfb-c721-4ce2-a76a-4c7cf37297c4] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:54.824518 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5860e65c-f5b7-416c-8139-bdf2ad5c5250 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:54.825300 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5860e65c-f5b7-416c-8139-bdf2ad5c5250 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:54.826148 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5860e65c-f5b7-416c-8139-bdf2ad5c5250 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:54.826656 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-5860e65c-f5b7-416c-8139-bdf2ad5c5250 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:55.068348 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-5860e65c-f5b7-416c-8139-bdf2ad5c5250 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560c53f082994abdb68e8b7113fc5831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723890dbe52c422ba8347b7b842a0cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:55.076739 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-5860e65c-f5b7-416c-8139-bdf2ad5c5250 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] 10.222.0.55 "GET /compute/v2.1/servers/a4fecbfb-c721-4ce2-a76a-4c7cf37297c4" status: 200 len: 1313 microversion: 2.1 time: 0.264610 Jul 25 23:11:55.078079 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 430/862] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:54 2022] GET /compute/v2.1/servers/a4fecbfb-c721-4ce2-a76a-4c7cf37297c4 => generated 1313 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:11:55.959738 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-53b67647-dc48-4922-a939-587bae3f42aa req-6e4cfa93-a187-494b-bb6e-29fc06362d99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf", "tag": "b8685360-29d7-4321-89d9-cdb5d87c4964"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:11:55.969766 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-53b67647-dc48-4922-a939-587bae3f42aa req-6e4cfa93-a187-494b-bb6e-29fc06362d99 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:55.970206 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-53b67647-dc48-4922-a939-587bae3f42aa req-6e4cfa93-a187-494b-bb6e-29fc06362d99 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:55.982451 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-53b67647-dc48-4922-a939-587bae3f42aa req-6e4cfa93-a187-494b-bb6e-29fc06362d99 service nova] Creating event network-changed:b8685360-29d7-4321-89d9-cdb5d87c4964 for instance d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf on hv-cinder-79760 Jul 25 23:11:55.987619 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-53b67647-dc48-4922-a939-587bae3f42aa req-6e4cfa93-a187-494b-bb6e-29fc06362d99 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032434 Jul 25 23:11:55.988225 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 433/863] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:11:56.098138 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-0eabd9db-8a98-4c15-b3f8-917880ffa778 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:56.098747 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-0eabd9db-8a98-4c15-b3f8-917880ffa778 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] [instance: a4fecbfb-c721-4ce2-a76a-4c7cf37297c4] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:56.106040 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0eabd9db-8a98-4c15-b3f8-917880ffa778 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:56.106496 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0eabd9db-8a98-4c15-b3f8-917880ffa778 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:56.107274 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0eabd9db-8a98-4c15-b3f8-917880ffa778 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:56.107710 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0eabd9db-8a98-4c15-b3f8-917880ffa778 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:56.319031 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-0eabd9db-8a98-4c15-b3f8-917880ffa778 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560c53f082994abdb68e8b7113fc5831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723890dbe52c422ba8347b7b842a0cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:56.327796 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-0eabd9db-8a98-4c15-b3f8-917880ffa778 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] 10.222.0.55 "GET /compute/v2.1/servers/a4fecbfb-c721-4ce2-a76a-4c7cf37297c4" status: 200 len: 1313 microversion: 2.1 time: 0.233520 Jul 25 23:11:56.328647 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 431/864] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:56 2022] GET /compute/v2.1/servers/a4fecbfb-c721-4ce2-a76a-4c7cf37297c4 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:11:57.348854 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4171db46-8674-4d01-aad4-0f0b111ec1c7 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:57.349571 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4171db46-8674-4d01-aad4-0f0b111ec1c7 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] [instance: a4fecbfb-c721-4ce2-a76a-4c7cf37297c4] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:57.356152 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4171db46-8674-4d01-aad4-0f0b111ec1c7 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:57.356598 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4171db46-8674-4d01-aad4-0f0b111ec1c7 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:57.357388 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4171db46-8674-4d01-aad4-0f0b111ec1c7 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:57.357822 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4171db46-8674-4d01-aad4-0f0b111ec1c7 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:57.490075 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4171db46-8674-4d01-aad4-0f0b111ec1c7 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560c53f082994abdb68e8b7113fc5831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723890dbe52c422ba8347b7b842a0cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:57.498094 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4171db46-8674-4d01-aad4-0f0b111ec1c7 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] 10.222.0.55 "GET /compute/v2.1/servers/a4fecbfb-c721-4ce2-a76a-4c7cf37297c4" status: 200 len: 1313 microversion: 2.1 time: 0.153945 Jul 25 23:11:57.498652 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 434/865] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:57 2022] GET /compute/v2.1/servers/a4fecbfb-c721-4ce2-a76a-4c7cf37297c4 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:11:58.508067 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-e8c03d2c-f794-4020-9260-f801eaa3bd33 req-cb303a26-a893-488e-b717-d2ca211ef50e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4fecbfb-c721-4ce2-a76a-4c7cf37297c4", "name": "network-vif-plugged", "status": "completed", "tag": "1c1fd5f8-b8a8-4115-9cf4-9b35a3a972c6"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:11:58.517934 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-e8c03d2c-f794-4020-9260-f801eaa3bd33 req-cb303a26-a893-488e-b717-d2ca211ef50e service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:58.518375 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-e8c03d2c-f794-4020-9260-f801eaa3bd33 req-cb303a26-a893-488e-b717-d2ca211ef50e service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:58.519912 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0ab064da-a957-4a1e-8e21-520a639ec043 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:58.520517 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-0ab064da-a957-4a1e-8e21-520a639ec043 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] [instance: a4fecbfb-c721-4ce2-a76a-4c7cf37297c4] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:58.527679 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0ab064da-a957-4a1e-8e21-520a639ec043 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:58.528058 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0ab064da-a957-4a1e-8e21-520a639ec043 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:58.528836 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0ab064da-a957-4a1e-8e21-520a639ec043 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:58.529310 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0ab064da-a957-4a1e-8e21-520a639ec043 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:58.531011 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-e8c03d2c-f794-4020-9260-f801eaa3bd33 req-cb303a26-a893-488e-b717-d2ca211ef50e service nova] Creating event network-vif-plugged:1c1fd5f8-b8a8-4115-9cf4-9b35a3a972c6 for instance a4fecbfb-c721-4ce2-a76a-4c7cf37297c4 on hv-cinder-79760 Jul 25 23:11:58.536152 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-e8c03d2c-f794-4020-9260-f801eaa3bd33 req-cb303a26-a893-488e-b717-d2ca211ef50e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032963 Jul 25 23:11:58.536759 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 432/866] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:11:58.670883 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-0ab064da-a957-4a1e-8e21-520a639ec043 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560c53f082994abdb68e8b7113fc5831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723890dbe52c422ba8347b7b842a0cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:58.678531 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-0ab064da-a957-4a1e-8e21-520a639ec043 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] 10.222.0.55 "GET /compute/v2.1/servers/a4fecbfb-c721-4ce2-a76a-4c7cf37297c4" status: 200 len: 1313 microversion: 2.1 time: 0.162673 Jul 25 23:11:58.679381 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 435/867] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:58 2022] GET /compute/v2.1/servers/a4fecbfb-c721-4ce2-a76a-4c7cf37297c4 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:11:59.697971 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell0:SELECT=16 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:11:59.702631 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-80bd2e44-df8e-414f-96ca-04ab5c2841e9 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:11:59.703332 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-80bd2e44-df8e-414f-96ca-04ab5c2841e9 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] [instance: a4fecbfb-c721-4ce2-a76a-4c7cf37297c4] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:11:59.710214 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-80bd2e44-df8e-414f-96ca-04ab5c2841e9 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:59.712447 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-80bd2e44-df8e-414f-96ca-04ab5c2841e9 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:59.712447 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-80bd2e44-df8e-414f-96ca-04ab5c2841e9 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:11:59.712447 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-80bd2e44-df8e-414f-96ca-04ab5c2841e9 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:11:59.858381 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-80bd2e44-df8e-414f-96ca-04ab5c2841e9 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560c53f082994abdb68e8b7113fc5831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723890dbe52c422ba8347b7b842a0cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:11:59.865890 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-80bd2e44-df8e-414f-96ca-04ab5c2841e9 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] 10.222.0.55 "GET /compute/v2.1/servers/a4fecbfb-c721-4ce2-a76a-4c7cf37297c4" status: 200 len: 1313 microversion: 2.1 time: 0.168952 Jul 25 23:11:59.866446 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 433/868] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:11:59 2022] GET /compute/v2.1/servers/a4fecbfb-c721-4ce2-a76a-4c7cf37297c4 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:12:00.887617 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6b3fe592-845f-427d-95d1-57d28677444c tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:12:00.888221 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6b3fe592-845f-427d-95d1-57d28677444c tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] [instance: a4fecbfb-c721-4ce2-a76a-4c7cf37297c4] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:12:00.890214 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=2 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:12:00.891014 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=14 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:12:00.896485 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6b3fe592-845f-427d-95d1-57d28677444c tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:00.896940 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6b3fe592-845f-427d-95d1-57d28677444c tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:00.897755 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6b3fe592-845f-427d-95d1-57d28677444c tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:00.898814 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6b3fe592-845f-427d-95d1-57d28677444c tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:01.029636 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6b3fe592-845f-427d-95d1-57d28677444c tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560c53f082994abdb68e8b7113fc5831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723890dbe52c422ba8347b7b842a0cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:12:01.037063 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6b3fe592-845f-427d-95d1-57d28677444c tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] 10.222.0.55 "GET /compute/v2.1/servers/a4fecbfb-c721-4ce2-a76a-4c7cf37297c4" status: 200 len: 1497 microversion: 2.1 time: 0.153358 Jul 25 23:12:01.037651 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 436/869] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:12:00 2022] GET /compute/v2.1/servers/a4fecbfb-c721-4ce2-a76a-4c7cf37297c4 => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:12:01.944058 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-f490b74c-b9be-4585-af82-6020f7a0b59a tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:12:01.944618 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-f490b74c-b9be-4585-af82-6020f7a0b59a tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] [instance: a4fecbfb-c721-4ce2-a76a-4c7cf37297c4] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:12:01.951576 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f490b74c-b9be-4585-af82-6020f7a0b59a tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:01.952031 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f490b74c-b9be-4585-af82-6020f7a0b59a tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:01.952805 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f490b74c-b9be-4585-af82-6020f7a0b59a tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:01.953275 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f490b74c-b9be-4585-af82-6020f7a0b59a tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:01.979958 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-f490b74c-b9be-4585-af82-6020f7a0b59a tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] [instance: a4fecbfb-c721-4ce2-a76a-4c7cf37297c4] Going to try to terminate instance {{(pid=118409) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 23:12:02.249354 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-f490b74c-b9be-4585-af82-6020f7a0b59a tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] 10.222.0.55 "DELETE /compute/v2.1/servers/a4fecbfb-c721-4ce2-a76a-4c7cf37297c4" status: 204 len: 0 microversion: 2.1 time: 0.308748 Jul 25 23:12:02.249892 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 434/870] 10.222.0.55 () {58 vars in 1239 bytes} [Mon Jul 25 23:12:01 2022] DELETE /compute/v2.1/servers/a4fecbfb-c721-4ce2-a76a-4c7cf37297c4 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 23:12:02.258559 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6cec8501-1d21-405f-9279-c74add62ce6b tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:12:02.259167 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6cec8501-1d21-405f-9279-c74add62ce6b tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] [instance: a4fecbfb-c721-4ce2-a76a-4c7cf37297c4] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:12:02.265754 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6cec8501-1d21-405f-9279-c74add62ce6b tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:02.266206 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6cec8501-1d21-405f-9279-c74add62ce6b tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:02.266971 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6cec8501-1d21-405f-9279-c74add62ce6b tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:02.267403 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6cec8501-1d21-405f-9279-c74add62ce6b tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:02.404633 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6cec8501-1d21-405f-9279-c74add62ce6b tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560c53f082994abdb68e8b7113fc5831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723890dbe52c422ba8347b7b842a0cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:12:02.412193 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6cec8501-1d21-405f-9279-c74add62ce6b tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] 10.222.0.55 "GET /compute/v2.1/servers/a4fecbfb-c721-4ce2-a76a-4c7cf37297c4" status: 200 len: 1503 microversion: 2.1 time: 0.157997 Jul 25 23:12:02.412761 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 437/871] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:12:02 2022] GET /compute/v2.1/servers/a4fecbfb-c721-4ce2-a76a-4c7cf37297c4 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:12:03.435347 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-bb5e566b-221e-4644-b4d9-6ababb97fcb0 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:12:03.436173 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-bb5e566b-221e-4644-b4d9-6ababb97fcb0 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] [instance: a4fecbfb-c721-4ce2-a76a-4c7cf37297c4] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:12:03.443323 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-bb5e566b-221e-4644-b4d9-6ababb97fcb0 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:03.443772 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-bb5e566b-221e-4644-b4d9-6ababb97fcb0 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:03.445508 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-bb5e566b-221e-4644-b4d9-6ababb97fcb0 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:03.445948 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-bb5e566b-221e-4644-b4d9-6ababb97fcb0 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:03.579952 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-bb5e566b-221e-4644-b4d9-6ababb97fcb0 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560c53f082994abdb68e8b7113fc5831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723890dbe52c422ba8347b7b842a0cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:12:03.587752 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-bb5e566b-221e-4644-b4d9-6ababb97fcb0 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] 10.222.0.55 "GET /compute/v2.1/servers/a4fecbfb-c721-4ce2-a76a-4c7cf37297c4" status: 200 len: 1503 microversion: 2.1 time: 0.156703 Jul 25 23:12:03.588308 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 435/872] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:12:03 2022] GET /compute/v2.1/servers/a4fecbfb-c721-4ce2-a76a-4c7cf37297c4 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:12:04.357311 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-40c41391-0cfe-4b65-9b31-d3970f18f1d2 req-6b9b3312-ecd3-41fb-822b-000cd515eea1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4fecbfb-c721-4ce2-a76a-4c7cf37297c4", "name": "network-vif-deleted", "tag": "1c1fd5f8-b8a8-4115-9cf4-9b35a3a972c6"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:12:04.368003 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-40c41391-0cfe-4b65-9b31-d3970f18f1d2 req-6b9b3312-ecd3-41fb-822b-000cd515eea1 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:04.373231 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-40c41391-0cfe-4b65-9b31-d3970f18f1d2 req-6b9b3312-ecd3-41fb-822b-000cd515eea1 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:04.379923 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-40c41391-0cfe-4b65-9b31-d3970f18f1d2 req-6b9b3312-ecd3-41fb-822b-000cd515eea1 service nova] Creating event network-vif-deleted:1c1fd5f8-b8a8-4115-9cf4-9b35a3a972c6 for instance a4fecbfb-c721-4ce2-a76a-4c7cf37297c4 on hv-cinder-79760 Jul 25 23:12:04.385511 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-40c41391-0cfe-4b65-9b31-d3970f18f1d2 req-6b9b3312-ecd3-41fb-822b-000cd515eea1 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032866 Jul 25 23:12:04.386126 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 438/873] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:12:04.609523 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-73483b49-c22d-419b-aaa8-05373c3d0685 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:12:04.610214 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-73483b49-c22d-419b-aaa8-05373c3d0685 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] [instance: a4fecbfb-c721-4ce2-a76a-4c7cf37297c4] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:12:04.617650 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-73483b49-c22d-419b-aaa8-05373c3d0685 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:04.618230 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-73483b49-c22d-419b-aaa8-05373c3d0685 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:04.619001 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-73483b49-c22d-419b-aaa8-05373c3d0685 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:04.619435 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-73483b49-c22d-419b-aaa8-05373c3d0685 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:04.651630 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-73483b49-c22d-419b-aaa8-05373c3d0685 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:04.652114 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-73483b49-c22d-419b-aaa8-05373c3d0685 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:04.652695 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.objects.instance [None req-73483b49-c22d-419b-aaa8-05373c3d0685 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lazy-loading 'fault' on Instance uuid a4fecbfb-c721-4ce2-a76a-4c7cf37297c4 {{(pid=118409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 23:12:04.694305 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-73483b49-c22d-419b-aaa8-05373c3d0685 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '560c53f082994abdb68e8b7113fc5831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723890dbe52c422ba8347b7b842a0cd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:12:04.701994 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-73483b49-c22d-419b-aaa8-05373c3d0685 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] 10.222.0.55 "GET /compute/v2.1/servers/a4fecbfb-c721-4ce2-a76a-4c7cf37297c4" status: 200 len: 1303 microversion: 2.1 time: 0.096567 Jul 25 23:12:04.702558 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 436/874] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:12:04 2022] GET /compute/v2.1/servers/a4fecbfb-c721-4ce2-a76a-4c7cf37297c4 => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:12:05.729200 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-3b5fa0b7-1f54-477c-9d63-5c375f739ca8 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:12:05.729902 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-3b5fa0b7-1f54-477c-9d63-5c375f739ca8 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] [instance: a4fecbfb-c721-4ce2-a76a-4c7cf37297c4] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:12:05.736617 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3b5fa0b7-1f54-477c-9d63-5c375f739ca8 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:05.737075 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3b5fa0b7-1f54-477c-9d63-5c375f739ca8 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:05.737862 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3b5fa0b7-1f54-477c-9d63-5c375f739ca8 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:05.738304 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3b5fa0b7-1f54-477c-9d63-5c375f739ca8 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:05.751734 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-3b5fa0b7-1f54-477c-9d63-5c375f739ca8 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] HTTP exception thrown: Instance a4fecbfb-c721-4ce2-a76a-4c7cf37297c4 could not be found. Jul 25 23:12:05.753386 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-3b5fa0b7-1f54-477c-9d63-5c375f739ca8 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Request method failure captured: Jul 25 23:12:05.753386 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/servers/a4fecbfb-c721-4ce2-a76a-4c7cf37297c4 HTTP/1.1 Jul 25 23:12:05.753386 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 25 23:12:05.753386 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 25 23:12:05.753386 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Connection: close Jul 25 23:12:05.753386 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 25 23:12:05.753386 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 25 23:12:05.753386 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Host: 10.222.0.55 Jul 25 23:12:05.753386 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 25 23:12:05.753386 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.10 Jul 25 23:12:05.753386 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABi3yMgyVRsRf-it71ypOxnfw0svQVT6SUTLDydNaJGYw0qLg5Qb35LNEk3rLKlFbVlNIL9Fufgr0x5fPVuhkldgFZ2IsIyLAPoVbhOQDzacPVLHezdaATkzlWn-jfGGtEIBPBkmqCrfH-LZUCTdW0kZOY4UAjDV1lL36wMOXdQ7Rd6to4 Jul 25 23:12:05.753386 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 25 23:12:05.753386 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 25 23:12:05.753386 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 25 23:12:05.753386 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 25 23:12:05.753386 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 25 23:12:05.753386 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 25 23:12:05.753386 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Id: 723890dbe52c422ba8347b7b842a0cd9 Jul 25 23:12:05.753386 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-VolumesActionsTest-98829762 Jul 25 23:12:05.753386 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Role: reader,member Jul 25 23:12:05.753386 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Roles: reader,member Jul 25 23:12:05.754911 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/723890dbe52c422ba8347b7b842a0cd9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/723890dbe52c422ba8347b7b842a0cd9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_723890dbe52c422ba8347b7b842a0cd9", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/723890dbe52c422ba8347b7b842a0cd9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:12:05.754911 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-VolumesActionsTest-98829762 Jul 25 23:12:05.754911 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Id: 723890dbe52c422ba8347b7b842a0cd9 Jul 25 23:12:05.754911 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-VolumesActionsTest-98829762 Jul 25 23:12:05.754911 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User: tempest-VolumesActionsTest-98829762-project Jul 25 23:12:05.754911 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 25 23:12:05.754911 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 25 23:12:05.754911 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Id: 560c53f082994abdb68e8b7113fc5831 Jul 25 23:12:05.754911 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-VolumesActionsTest-98829762-project Jul 25 23:12:05.754911 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: method: > Jul 25 23:12:05.754911 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: exception: Instance a4fecbfb-c721-4ce2-a76a-4c7cf37297c4 could not be found. Jul 25 23:12:05.754911 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: action_args: {'id': 'a4fecbfb-c721-4ce2-a76a-4c7cf37297c4'} Jul 25 23:12:05.755764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:12:05.755764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:12:05.755764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:12:05.755764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:12:05.755764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:12:05.755764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:12:05.755764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:12:05.755764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:12:05.755764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:12:05.755764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:12:05.755764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4fecbfb-c721-4ce2-a76a-4c7cf37297c4 could not be found. Jul 25 23:12:05.755764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:12:05.755764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:12:05.755764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:12:05.755764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:12:05.755764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:12:05.755764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:12:05.755764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:12:05.755764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:12:05.755764 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:12:05.756972 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:12:05.756972 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 23:12:05.756972 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 23:12:05.756972 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:12:05.756972 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:12:05.756972 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:12:05.756972 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:12:05.756972 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4fecbfb-c721-4ce2-a76a-4c7cf37297c4 could not be found. Jul 25 23:12:05.756972 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:12:05.756972 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:12:05.756972 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:12:05.756972 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:12:05.756972 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:12:05.756972 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:12:05.756972 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:12:05.756972 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:12:05.756972 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4fecbfb-c721-4ce2-a76a-4c7cf37297c4 could not be found. Jul 25 23:12:05.756972 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:12:05.759056 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-3b5fa0b7-1f54-477c-9d63-5c375f739ca8 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] Returning 404 to user: Instance a4fecbfb-c721-4ce2-a76a-4c7cf37297c4 could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:12:05.759056 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-3b5fa0b7-1f54-477c-9d63-5c375f739ca8 tempest-VolumesActionsTest-98829762 tempest-VolumesActionsTest-98829762-project] 10.222.0.55 "GET /compute/v2.1/servers/a4fecbfb-c721-4ce2-a76a-4c7cf37297c4" status: 404 len: 111 microversion: 2.1 time: 0.029877 Jul 25 23:12:05.759056 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 439/875] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:12:05 2022] GET /compute/v2.1/servers/a4fecbfb-c721-4ce2-a76a-4c7cf37297c4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:12:30.885307 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-cf6bc8e4-c851-47cb-91fc-78d05c6de284 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:12:30.885813 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-cf6bc8e4-c851-47cb-91fc-78d05c6de284 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:12:30.888160 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:12:30.888803 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:12:30.893786 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cf6bc8e4-c851-47cb-91fc-78d05c6de284 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:30.894234 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cf6bc8e4-c851-47cb-91fc-78d05c6de284 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:30.894988 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cf6bc8e4-c851-47cb-91fc-78d05c6de284 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:30.895418 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cf6bc8e4-c851-47cb-91fc-78d05c6de284 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:30.918736 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-cf6bc8e4-c851-47cb-91fc-78d05c6de284 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf/ips" status: 200 len: 148 microversion: 2.1 time: 0.037811 Jul 25 23:12:30.919289 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 437/876] 10.222.0.55 () {58 vars in 1248 bytes} [Mon Jul 25 23:12:30 2022] GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:12:32.654283 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-47876606-8f35-4d30-81f7-e75e4fd9b3d6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01ce251a-a79d-432b-8c60-daa56ce1a442"}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:12:32.656597 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-47876606-8f35-4d30-81f7-e75e4fd9b3d6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:12:32.658916 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:12:32.659560 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=67 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:12:32.665311 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-47876606-8f35-4d30-81f7-e75e4fd9b3d6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:32.665758 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-47876606-8f35-4d30-81f7-e75e4fd9b3d6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:32.666527 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-47876606-8f35-4d30-81f7-e75e4fd9b3d6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:32.666961 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-47876606-8f35-4d30-81f7-e75e4fd9b3d6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:33.413309 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-47876606-8f35-4d30-81f7-e75e4fd9b3d6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "POST /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.762081 Jul 25 23:12:33.413927 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 440/877] 10.222.0.55 () {60 vars in 1323 bytes} [Mon Jul 25 23:12:32 2022] POST /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf/os-volume_attachments => generated 194 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:12:40.941432 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-badfccc9-1698-421f-9203-5aea638826a8 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Action: 'create', calling method: .version_select at 0x7f622f8011f0>, body: {"keypair": {"name": "tempest-keypair-1006213001", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNdNJeDewX08I/GMEcKpvUnCra1QEGkB7KZSxAm8hVRPvgchobrEQ9ykcskJ0/ELsxkBRtZ1iJVaoooOLHFTzHswjHwbRcskdpCSMBQpHIIUzBUvNei5aylp7O3p0F6Kw=="}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:12:40.959362 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-badfccc9-1698-421f-9203-5aea638826a8 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Getting quotas for project bca196a6befb4fae9531dc96a1e58d5f. Resources: {'key_pairs'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 23:12:40.963666 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-badfccc9-1698-421f-9203-5aea638826a8 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Getting quotas for user f54ad4a554de414a80ed03d62c1eb3a5 and project bca196a6befb4fae9531dc96a1e58d5f. Resources: {'key_pairs'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 23:12:41.047578 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-badfccc9-1698-421f-9203-5aea638826a8 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.110434 Jul 25 23:12:41.048104 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 438/878] 10.222.0.55 () {60 vars in 1159 bytes} [Mon Jul 25 23:12:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:12:43.338626 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-afdbd7c3-a8b8-479d-a04d-3461bb82afd0 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1306619663", "imageRef": "8e9f3265-0fdf-483a-8e2e-41d408f5f0e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "61b90c6f-f28d-4718-a9dc-fcf196e75d09"}], "security_groups": [{"name": "tempest-securitygroup--1874581337"}], "key_name": "tempest-keypair-1006213001", "user_data": "}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:12:43.347121 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=2 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:12:43.347826 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:12:43.449960 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.network.neutron [None req-afdbd7c3-a8b8-479d-a04d-3461bb82afd0 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] validate_networks() for [('61b90c6f-f28d-4718-a9dc-fcf196e75d09', None, None, None, None, None)] {{(pid=118410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 23:12:44.045432 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-afdbd7c3-a8b8-479d-a04d-3461bb82afd0 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Flavor limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 23:12:44.045857 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-afdbd7c3-a8b8-479d-a04d-3461bb82afd0 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Image limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 23:12:44.046361 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-afdbd7c3-a8b8-479d-a04d-3461bb82afd0 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Flavor pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 23:12:44.046773 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-afdbd7c3-a8b8-479d-a04d-3461bb82afd0 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Image pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 23:12:44.047184 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-afdbd7c3-a8b8-479d-a04d-3461bb82afd0 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 23:12:44.056401 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-afdbd7c3-a8b8-479d-a04d-3461bb82afd0 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:44.056851 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-afdbd7c3-a8b8-479d-a04d-3461bb82afd0 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:44.057716 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-afdbd7c3-a8b8-479d-a04d-3461bb82afd0 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:44.058155 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-afdbd7c3-a8b8-479d-a04d-3461bb82afd0 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:44.075140 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-afdbd7c3-a8b8-479d-a04d-3461bb82afd0 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Getting quotas for project bca196a6befb4fae9531dc96a1e58d5f. Resources: {'instances', 'cores', 'ram'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 23:12:44.079250 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-afdbd7c3-a8b8-479d-a04d-3461bb82afd0 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Getting quotas for user f54ad4a554de414a80ed03d62c1eb3a5 and project bca196a6befb4fae9531dc96a1e58d5f. Resources: {'instances', 'cores', 'ram'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 23:12:44.092307 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-afdbd7c3-a8b8-479d-a04d-3461bb82afd0 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Going to run 1 instances... {{(pid=118410) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 23:12:44.094688 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-afdbd7c3-a8b8-479d-a04d-3461bb82afd0 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 6da72d7b-eb7f-4135-97e0-49f603ac903d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e9f3265-0fdf-483a-8e2e-41d408f5f0e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 23:12:44.253199 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-afdbd7c3-a8b8-479d-a04d-3461bb82afd0 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.919816 Jul 25 23:12:44.253838 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 441/879] 10.222.0.55 () {60 vars in 1147 bytes} [Mon Jul 25 23:12:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 23:12:44.266269 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-cbe17276-3e36-4717-aaa3-dfbfc4170c48 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:12:44.266999 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-cbe17276-3e36-4717-aaa3-dfbfc4170c48 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 6da72d7b-eb7f-4135-97e0-49f603ac903d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:12:44.323480 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-cbe17276-3e36-4717-aaa3-dfbfc4170c48 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:12:44.331083 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-cbe17276-3e36-4717-aaa3-dfbfc4170c48 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d" status: 200 len: 1242 microversion: 2.1 time: 0.069247 Jul 25 23:12:44.331876 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 439/880] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:12:44 2022] GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:12:45.354819 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-ad54773d-099a-44b8-80ab-8bdba6760935 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:12:45.355588 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-ad54773d-099a-44b8-80ab-8bdba6760935 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 6da72d7b-eb7f-4135-97e0-49f603ac903d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:12:45.362882 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ad54773d-099a-44b8-80ab-8bdba6760935 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:45.363316 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ad54773d-099a-44b8-80ab-8bdba6760935 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:45.364085 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ad54773d-099a-44b8-80ab-8bdba6760935 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:45.364514 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ad54773d-099a-44b8-80ab-8bdba6760935 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:45.427225 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-ad54773d-099a-44b8-80ab-8bdba6760935 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:12:45.434971 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-ad54773d-099a-44b8-80ab-8bdba6760935 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d" status: 200 len: 1238 microversion: 2.1 time: 0.085679 Jul 25 23:12:45.435526 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 442/881] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:12:45 2022] GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d => generated 1238 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:12:46.456461 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-6cc9bc9f-0087-4210-b398-f0bb41bff924 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:12:46.457068 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-6cc9bc9f-0087-4210-b398-f0bb41bff924 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 6da72d7b-eb7f-4135-97e0-49f603ac903d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:12:46.464409 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6cc9bc9f-0087-4210-b398-f0bb41bff924 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:46.464857 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6cc9bc9f-0087-4210-b398-f0bb41bff924 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:46.465657 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6cc9bc9f-0087-4210-b398-f0bb41bff924 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:46.466155 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6cc9bc9f-0087-4210-b398-f0bb41bff924 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:46.566863 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-6cc9bc9f-0087-4210-b398-f0bb41bff924 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:12:46.576283 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-6cc9bc9f-0087-4210-b398-f0bb41bff924 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d" status: 200 len: 1302 microversion: 2.1 time: 0.123688 Jul 25 23:12:46.585239 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 440/882] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:12:46 2022] GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d => generated 1302 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:12:47.603916 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4f511925-b4e0-4bc3-ad80-5450551f20d2 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:12:47.604525 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4f511925-b4e0-4bc3-ad80-5450551f20d2 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 6da72d7b-eb7f-4135-97e0-49f603ac903d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:12:47.611368 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4f511925-b4e0-4bc3-ad80-5450551f20d2 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:47.611829 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4f511925-b4e0-4bc3-ad80-5450551f20d2 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:47.612603 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4f511925-b4e0-4bc3-ad80-5450551f20d2 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:47.613039 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4f511925-b4e0-4bc3-ad80-5450551f20d2 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:47.861852 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4f511925-b4e0-4bc3-ad80-5450551f20d2 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:12:47.872014 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4f511925-b4e0-4bc3-ad80-5450551f20d2 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d" status: 200 len: 1368 microversion: 2.1 time: 0.272049 Jul 25 23:12:47.872665 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 443/883] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:12:47 2022] GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d => generated 1368 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:12:48.407842 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-a9edbd7b-ee11-408b-b883-f82254f0d367 req-4816cae1-1c67-4270-9686-b20c1c9da4bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6da72d7b-eb7f-4135-97e0-49f603ac903d", "tag": "a1475c86-1303-418b-ac04-a925f55290e8"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:12:48.421398 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-a9edbd7b-ee11-408b-b883-f82254f0d367 req-4816cae1-1c67-4270-9686-b20c1c9da4bf service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:48.421842 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-a9edbd7b-ee11-408b-b883-f82254f0d367 req-4816cae1-1c67-4270-9686-b20c1c9da4bf service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:48.434208 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-a9edbd7b-ee11-408b-b883-f82254f0d367 req-4816cae1-1c67-4270-9686-b20c1c9da4bf service nova] Creating event network-changed:a1475c86-1303-418b-ac04-a925f55290e8 for instance 6da72d7b-eb7f-4135-97e0-49f603ac903d on hv-cinder-79760 Jul 25 23:12:48.440283 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-a9edbd7b-ee11-408b-b883-f82254f0d367 req-4816cae1-1c67-4270-9686-b20c1c9da4bf service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036086 Jul 25 23:12:48.440283 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 441/884] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:12:48.893833 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-fd929c38-e1d2-4a08-821c-acbe101ec586 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:12:48.894431 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-fd929c38-e1d2-4a08-821c-acbe101ec586 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 6da72d7b-eb7f-4135-97e0-49f603ac903d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:12:48.901680 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fd929c38-e1d2-4a08-821c-acbe101ec586 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:48.902124 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fd929c38-e1d2-4a08-821c-acbe101ec586 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:48.902884 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fd929c38-e1d2-4a08-821c-acbe101ec586 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:48.903317 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fd929c38-e1d2-4a08-821c-acbe101ec586 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:49.099180 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-fd929c38-e1d2-4a08-821c-acbe101ec586 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:12:49.106904 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-fd929c38-e1d2-4a08-821c-acbe101ec586 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d" status: 200 len: 1368 microversion: 2.1 time: 0.217140 Jul 25 23:12:49.107405 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 444/885] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:12:48 2022] GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d => generated 1368 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:12:50.128807 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-2adc008f-90d7-44e2-bb5e-3e28156ad761 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:12:50.129648 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-2adc008f-90d7-44e2-bb5e-3e28156ad761 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 6da72d7b-eb7f-4135-97e0-49f603ac903d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:12:50.135894 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2adc008f-90d7-44e2-bb5e-3e28156ad761 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:50.136336 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2adc008f-90d7-44e2-bb5e-3e28156ad761 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:50.137094 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2adc008f-90d7-44e2-bb5e-3e28156ad761 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:50.137556 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2adc008f-90d7-44e2-bb5e-3e28156ad761 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:50.267247 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-2adc008f-90d7-44e2-bb5e-3e28156ad761 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:12:50.274888 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-2adc008f-90d7-44e2-bb5e-3e28156ad761 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d" status: 200 len: 1368 microversion: 2.1 time: 0.150854 Jul 25 23:12:50.279568 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 442/886] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:12:50 2022] GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:12:51.296075 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b8053fa9-30df-4efd-bfb5-c9d76f8092eb tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:12:51.296602 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b8053fa9-30df-4efd-bfb5-c9d76f8092eb tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 6da72d7b-eb7f-4135-97e0-49f603ac903d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:12:51.303927 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b8053fa9-30df-4efd-bfb5-c9d76f8092eb tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:51.304370 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b8053fa9-30df-4efd-bfb5-c9d76f8092eb tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:51.305143 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b8053fa9-30df-4efd-bfb5-c9d76f8092eb tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:51.305576 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b8053fa9-30df-4efd-bfb5-c9d76f8092eb tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:51.432761 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b8053fa9-30df-4efd-bfb5-c9d76f8092eb tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:12:51.440758 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b8053fa9-30df-4efd-bfb5-c9d76f8092eb tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d" status: 200 len: 1368 microversion: 2.1 time: 0.148682 Jul 25 23:12:51.441352 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 445/887] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:12:51 2022] GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:12:52.462176 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-d48a608b-a99d-4784-9e29-4e8e0b7afaed tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:12:52.462784 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-d48a608b-a99d-4784-9e29-4e8e0b7afaed tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 6da72d7b-eb7f-4135-97e0-49f603ac903d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:12:52.469463 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d48a608b-a99d-4784-9e29-4e8e0b7afaed tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:52.470762 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d48a608b-a99d-4784-9e29-4e8e0b7afaed tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:52.470762 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d48a608b-a99d-4784-9e29-4e8e0b7afaed tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:52.471189 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d48a608b-a99d-4784-9e29-4e8e0b7afaed tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:52.603921 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-d48a608b-a99d-4784-9e29-4e8e0b7afaed tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:12:52.611320 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-d48a608b-a99d-4784-9e29-4e8e0b7afaed tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d" status: 200 len: 1368 microversion: 2.1 time: 0.153620 Jul 25 23:12:52.611872 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 443/888] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:12:52 2022] GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:12:53.632393 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0cdaf2bc-9dc4-4449-8381-a74d1cf8fd67 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:12:53.633246 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-0cdaf2bc-9dc4-4449-8381-a74d1cf8fd67 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 6da72d7b-eb7f-4135-97e0-49f603ac903d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:12:53.639564 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0cdaf2bc-9dc4-4449-8381-a74d1cf8fd67 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:53.640005 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0cdaf2bc-9dc4-4449-8381-a74d1cf8fd67 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:53.640765 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0cdaf2bc-9dc4-4449-8381-a74d1cf8fd67 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:53.641223 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0cdaf2bc-9dc4-4449-8381-a74d1cf8fd67 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:53.772637 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-0cdaf2bc-9dc4-4449-8381-a74d1cf8fd67 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:12:53.780160 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-0cdaf2bc-9dc4-4449-8381-a74d1cf8fd67 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d" status: 200 len: 1368 microversion: 2.1 time: 0.152213 Jul 25 23:12:53.781175 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 446/889] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:12:53 2022] GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:12:54.808063 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-b735c898-56c8-4e8a-becd-b39b09bc95d1 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:12:54.808737 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-b735c898-56c8-4e8a-becd-b39b09bc95d1 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 6da72d7b-eb7f-4135-97e0-49f603ac903d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:12:54.811500 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell0:SELECT=6 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:12:54.816341 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b735c898-56c8-4e8a-becd-b39b09bc95d1 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:54.816795 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b735c898-56c8-4e8a-becd-b39b09bc95d1 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:54.817591 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b735c898-56c8-4e8a-becd-b39b09bc95d1 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:54.818032 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b735c898-56c8-4e8a-becd-b39b09bc95d1 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:54.954263 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-b735c898-56c8-4e8a-becd-b39b09bc95d1 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:12:54.962561 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-b735c898-56c8-4e8a-becd-b39b09bc95d1 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d" status: 200 len: 1368 microversion: 2.1 time: 0.158448 Jul 25 23:12:54.963115 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 444/890] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:12:54 2022] GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:12:55.985420 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0a0331f7-aeae-484f-a3af-bf88597a6ef5 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:12:55.986372 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-0a0331f7-aeae-484f-a3af-bf88597a6ef5 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 6da72d7b-eb7f-4135-97e0-49f603ac903d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:12:55.989488 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=2 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:12:55.990747 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=6 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:12:55.995158 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0a0331f7-aeae-484f-a3af-bf88597a6ef5 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:55.995918 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0a0331f7-aeae-484f-a3af-bf88597a6ef5 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:55.998150 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0a0331f7-aeae-484f-a3af-bf88597a6ef5 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:55.998605 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0a0331f7-aeae-484f-a3af-bf88597a6ef5 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:56.136819 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-0a0331f7-aeae-484f-a3af-bf88597a6ef5 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:12:56.144608 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-0a0331f7-aeae-484f-a3af-bf88597a6ef5 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d" status: 200 len: 1368 microversion: 2.1 time: 0.164208 Jul 25 23:12:56.145190 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 447/891] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:12:55 2022] GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:12:56.687350 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-ad252219-0b55-428f-bc99-417cd9d6824b req-4aa1eef4-5972-44cf-ab43-5e3265aa70af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6da72d7b-eb7f-4135-97e0-49f603ac903d", "name": "network-vif-plugged", "status": "completed", "tag": "a1475c86-1303-418b-ac04-a925f55290e8"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:12:56.697994 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-ad252219-0b55-428f-bc99-417cd9d6824b req-4aa1eef4-5972-44cf-ab43-5e3265aa70af service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:56.698662 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-ad252219-0b55-428f-bc99-417cd9d6824b req-4aa1eef4-5972-44cf-ab43-5e3265aa70af service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:56.709657 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-ad252219-0b55-428f-bc99-417cd9d6824b req-4aa1eef4-5972-44cf-ab43-5e3265aa70af service nova] Creating event network-vif-plugged:a1475c86-1303-418b-ac04-a925f55290e8 for instance 6da72d7b-eb7f-4135-97e0-49f603ac903d on hv-cinder-79760 Jul 25 23:12:56.714511 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-ad252219-0b55-428f-bc99-417cd9d6824b req-4aa1eef4-5972-44cf-ab43-5e3265aa70af service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030920 Jul 25 23:12:56.715131 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 445/892] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:12:57.168614 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c0d74faa-83ce-4eb1-aba6-6619d232120d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:12:57.169383 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c0d74faa-83ce-4eb1-aba6-6619d232120d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 6da72d7b-eb7f-4135-97e0-49f603ac903d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:12:57.175926 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c0d74faa-83ce-4eb1-aba6-6619d232120d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:57.176380 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c0d74faa-83ce-4eb1-aba6-6619d232120d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:57.177762 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c0d74faa-83ce-4eb1-aba6-6619d232120d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:57.178171 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c0d74faa-83ce-4eb1-aba6-6619d232120d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:57.311809 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c0d74faa-83ce-4eb1-aba6-6619d232120d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:12:57.319396 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c0d74faa-83ce-4eb1-aba6-6619d232120d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d" status: 200 len: 1368 microversion: 2.1 time: 0.157948 Jul 25 23:12:57.319950 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 448/893] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:12:57 2022] GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:12:58.341322 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-3bce7418-bc73-4f31-a8c4-789f1a05d843 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:12:58.342063 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-3bce7418-bc73-4f31-a8c4-789f1a05d843 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 6da72d7b-eb7f-4135-97e0-49f603ac903d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:12:58.348249 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3bce7418-bc73-4f31-a8c4-789f1a05d843 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:58.348714 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3bce7418-bc73-4f31-a8c4-789f1a05d843 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:58.349622 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3bce7418-bc73-4f31-a8c4-789f1a05d843 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:58.350046 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-3bce7418-bc73-4f31-a8c4-789f1a05d843 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:58.480734 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-3bce7418-bc73-4f31-a8c4-789f1a05d843 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:12:58.488119 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-3bce7418-bc73-4f31-a8c4-789f1a05d843 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d" status: 200 len: 1368 microversion: 2.1 time: 0.151476 Jul 25 23:12:58.488656 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 446/894] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:12:58 2022] GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:12:59.509249 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c0b14319-cd2c-4f4e-9b66-28226bfde832 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:12:59.509795 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c0b14319-cd2c-4f4e-9b66-28226bfde832 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 6da72d7b-eb7f-4135-97e0-49f603ac903d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:12:59.516281 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c0b14319-cd2c-4f4e-9b66-28226bfde832 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:59.516725 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c0b14319-cd2c-4f4e-9b66-28226bfde832 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:59.517512 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c0b14319-cd2c-4f4e-9b66-28226bfde832 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:12:59.518197 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c0b14319-cd2c-4f4e-9b66-28226bfde832 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:12:59.705849 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c0b14319-cd2c-4f4e-9b66-28226bfde832 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:12:59.714748 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c0b14319-cd2c-4f4e-9b66-28226bfde832 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d" status: 200 len: 1368 microversion: 2.1 time: 0.209547 Jul 25 23:12:59.715286 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 449/895] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:12:59 2022] GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d => generated 1368 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:13:00.737685 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-9636ffa7-6214-4024-a326-6320515fcd44 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:00.737685 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-9636ffa7-6214-4024-a326-6320515fcd44 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 6da72d7b-eb7f-4135-97e0-49f603ac903d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:00.744490 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9636ffa7-6214-4024-a326-6320515fcd44 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:00.745015 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9636ffa7-6214-4024-a326-6320515fcd44 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:00.745891 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9636ffa7-6214-4024-a326-6320515fcd44 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:00.746412 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9636ffa7-6214-4024-a326-6320515fcd44 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:00.899452 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-9636ffa7-6214-4024-a326-6320515fcd44 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:13:00.907121 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-9636ffa7-6214-4024-a326-6320515fcd44 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d" status: 200 len: 1368 microversion: 2.1 time: 0.174555 Jul 25 23:13:00.907678 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 447/896] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:13:00 2022] GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:13:01.927823 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-3dd01e7f-092f-485e-9d49-41089d528530 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:01.928450 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-3dd01e7f-092f-485e-9d49-41089d528530 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 6da72d7b-eb7f-4135-97e0-49f603ac903d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:01.936291 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3dd01e7f-092f-485e-9d49-41089d528530 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:01.936740 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3dd01e7f-092f-485e-9d49-41089d528530 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:01.937575 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3dd01e7f-092f-485e-9d49-41089d528530 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:01.938011 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3dd01e7f-092f-485e-9d49-41089d528530 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:02.068453 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-3dd01e7f-092f-485e-9d49-41089d528530 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:13:02.076185 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-3dd01e7f-092f-485e-9d49-41089d528530 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d" status: 200 len: 1557 microversion: 2.1 time: 0.152251 Jul 25 23:13:02.076753 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 450/897] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:13:01 2022] GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:13:02.097292 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-040fd301-3b33-4eed-b2d6-f442dee7b06c tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:02.097835 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-040fd301-3b33-4eed-b2d6-f442dee7b06c tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 6da72d7b-eb7f-4135-97e0-49f603ac903d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:02.104710 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-040fd301-3b33-4eed-b2d6-f442dee7b06c tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:02.105184 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-040fd301-3b33-4eed-b2d6-f442dee7b06c tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:02.105949 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-040fd301-3b33-4eed-b2d6-f442dee7b06c tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:02.106380 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-040fd301-3b33-4eed-b2d6-f442dee7b06c tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:02.186160 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-040fd301-3b33-4eed-b2d6-f442dee7b06c tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092744 Jul 25 23:13:02.186756 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 448/898] 10.222.0.55 () {58 vars in 1275 bytes} [Mon Jul 25 23:13:02 2022] GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:13:03.420958 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-583115b6-1d1f-4b08-a19b-ce8d4591df54 req-ce2eb659-8808-4d48-8d41-fea15411941f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6da72d7b-eb7f-4135-97e0-49f603ac903d", "tag": "a1475c86-1303-418b-ac04-a925f55290e8"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:13:03.430979 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-583115b6-1d1f-4b08-a19b-ce8d4591df54 req-ce2eb659-8808-4d48-8d41-fea15411941f service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:03.431425 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-583115b6-1d1f-4b08-a19b-ce8d4591df54 req-ce2eb659-8808-4d48-8d41-fea15411941f service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:03.442521 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-583115b6-1d1f-4b08-a19b-ce8d4591df54 req-ce2eb659-8808-4d48-8d41-fea15411941f service nova] Creating event network-changed:a1475c86-1303-418b-ac04-a925f55290e8 for instance 6da72d7b-eb7f-4135-97e0-49f603ac903d on hv-cinder-79760 Jul 25 23:13:03.452170 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-583115b6-1d1f-4b08-a19b-ce8d4591df54 req-ce2eb659-8808-4d48-8d41-fea15411941f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030916 Jul 25 23:13:03.452170 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 451/899] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:13:09.265164 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-dffd6a64-0d93-4c1c-af91-bcd574ff6ba7 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-4217144", "imageRef": "8e9f3265-0fdf-483a-8e2e-41d408f5f0e7", "flavorRef": "452"}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:13:09.316535 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.network.neutron [None req-dffd6a64-0d93-4c1c-af91-bcd574ff6ba7 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] validate_networks() for None {{(pid=118409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 23:13:09.587236 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-dffd6a64-0d93-4c1c-af91-bcd574ff6ba7 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Flavor limits 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 23:13:09.587656 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-dffd6a64-0d93-4c1c-af91-bcd574ff6ba7 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Image limits 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 23:13:09.588128 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-dffd6a64-0d93-4c1c-af91-bcd574ff6ba7 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Flavor pref 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 23:13:09.589084 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-dffd6a64-0d93-4c1c-af91-bcd574ff6ba7 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Image pref 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 23:13:09.589517 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-dffd6a64-0d93-4c1c-af91-bcd574ff6ba7 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 23:13:09.598473 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-dffd6a64-0d93-4c1c-af91-bcd574ff6ba7 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:09.598921 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-dffd6a64-0d93-4c1c-af91-bcd574ff6ba7 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:09.599718 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-dffd6a64-0d93-4c1c-af91-bcd574ff6ba7 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:09.600155 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-dffd6a64-0d93-4c1c-af91-bcd574ff6ba7 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:09.617707 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-dffd6a64-0d93-4c1c-af91-bcd574ff6ba7 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Getting quotas for project 3520dc1ffe9040bc969cbc3b00052503. Resources: {'instances', 'cores', 'ram'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 23:13:09.621782 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-dffd6a64-0d93-4c1c-af91-bcd574ff6ba7 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Getting quotas for user ec27525586534109b2a6cb617a3d6378 and project 3520dc1ffe9040bc969cbc3b00052503. Resources: {'instances', 'cores', 'ram'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 23:13:09.632727 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-dffd6a64-0d93-4c1c-af91-bcd574ff6ba7 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Going to run 1 instances... {{(pid=118409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 23:13:09.634974 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-dffd6a64-0d93-4c1c-af91-bcd574ff6ba7 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] [instance: 94f37847-b0bb-49f3-85b4-b2f32c8d6571] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e9f3265-0fdf-483a-8e2e-41d408f5f0e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 23:13:09.755260 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-dffd6a64-0d93-4c1c-af91-bcd574ff6ba7 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.494824 Jul 25 23:13:09.755897 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 449/900] 10.222.0.55 () {60 vars in 1147 bytes} [Mon Jul 25 23:13:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 23:13:09.768682 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d1497854-5aa1-4cc0-852c-cb7b867eb579 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:09.769533 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-d1497854-5aa1-4cc0-852c-cb7b867eb579 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] [instance: 94f37847-b0bb-49f3-85b4-b2f32c8d6571] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:09.823220 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-d1497854-5aa1-4cc0-852c-cb7b867eb579 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec27525586534109b2a6cb617a3d6378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520dc1ffe9040bc969cbc3b00052503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:13:09.829952 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-d1497854-5aa1-4cc0-852c-cb7b867eb579 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] 10.222.0.55 "GET /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571" status: 200 len: 1212 microversion: 2.1 time: 0.066570 Jul 25 23:13:09.830517 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 452/901] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:13:09 2022] GET /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571 => generated 1212 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:13:10.852242 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-c5e43ec4-4feb-4a6b-92f6-e929766ffa5e tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:10.852850 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-c5e43ec4-4feb-4a6b-92f6-e929766ffa5e tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] [instance: 94f37847-b0bb-49f3-85b4-b2f32c8d6571] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:10.860903 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c5e43ec4-4feb-4a6b-92f6-e929766ffa5e tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:10.861176 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c5e43ec4-4feb-4a6b-92f6-e929766ffa5e tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:10.862034 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c5e43ec4-4feb-4a6b-92f6-e929766ffa5e tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:10.862544 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c5e43ec4-4feb-4a6b-92f6-e929766ffa5e tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:10.924272 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-c5e43ec4-4feb-4a6b-92f6-e929766ffa5e tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec27525586534109b2a6cb617a3d6378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520dc1ffe9040bc969cbc3b00052503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:13:10.931748 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-c5e43ec4-4feb-4a6b-92f6-e929766ffa5e tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] 10.222.0.55 "GET /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571" status: 200 len: 1216 microversion: 2.1 time: 0.084589 Jul 25 23:13:10.932305 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 450/902] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:13:10 2022] GET /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571 => generated 1216 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:13:11.953945 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d059bba5-374b-4027-a54b-81b37981ae2b tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:11.954551 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-d059bba5-374b-4027-a54b-81b37981ae2b tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] [instance: 94f37847-b0bb-49f3-85b4-b2f32c8d6571] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:11.962500 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d059bba5-374b-4027-a54b-81b37981ae2b tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:11.962945 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d059bba5-374b-4027-a54b-81b37981ae2b tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:11.963716 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d059bba5-374b-4027-a54b-81b37981ae2b tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:11.964790 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d059bba5-374b-4027-a54b-81b37981ae2b tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:12.045224 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-d059bba5-374b-4027-a54b-81b37981ae2b tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec27525586534109b2a6cb617a3d6378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520dc1ffe9040bc969cbc3b00052503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:13:12.051573 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-d059bba5-374b-4027-a54b-81b37981ae2b tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] 10.222.0.55 "GET /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571" status: 200 len: 1272 microversion: 2.1 time: 0.102836 Jul 25 23:13:12.052192 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 453/903] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:13:11 2022] GET /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571 => generated 1272 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:13:13.076017 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-a0024b43-397b-4c1a-8874-7b725acf9ec4 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:13.076628 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-a0024b43-397b-4c1a-8874-7b725acf9ec4 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] [instance: 94f37847-b0bb-49f3-85b4-b2f32c8d6571] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:13.086303 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a0024b43-397b-4c1a-8874-7b725acf9ec4 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:13.086303 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a0024b43-397b-4c1a-8874-7b725acf9ec4 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:13.086303 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a0024b43-397b-4c1a-8874-7b725acf9ec4 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:13.086303 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a0024b43-397b-4c1a-8874-7b725acf9ec4 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:13.286889 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-a0024b43-397b-4c1a-8874-7b725acf9ec4 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec27525586534109b2a6cb617a3d6378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520dc1ffe9040bc969cbc3b00052503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:13:13.294601 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-a0024b43-397b-4c1a-8874-7b725acf9ec4 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] 10.222.0.55 "GET /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571" status: 200 len: 1312 microversion: 2.1 time: 0.222533 Jul 25 23:13:13.295165 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 451/904] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:13:13 2022] GET /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571 => generated 1312 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:13:13.951866 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-dfac58d8-10ec-4a1d-9357-cfa234d06b78 req-69014925-de47-412f-9093-1bf623b6e6e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94f37847-b0bb-49f3-85b4-b2f32c8d6571", "tag": "33e226ab-f435-4647-9cb6-cbe108ed6b77"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:13:13.960783 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:13:13.963431 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-dfac58d8-10ec-4a1d-9357-cfa234d06b78 req-69014925-de47-412f-9093-1bf623b6e6e7 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:13.963870 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-dfac58d8-10ec-4a1d-9357-cfa234d06b78 req-69014925-de47-412f-9093-1bf623b6e6e7 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:13.972065 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=65 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:13:13.977762 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-dfac58d8-10ec-4a1d-9357-cfa234d06b78 req-69014925-de47-412f-9093-1bf623b6e6e7 service nova] Creating event network-changed:33e226ab-f435-4647-9cb6-cbe108ed6b77 for instance 94f37847-b0bb-49f3-85b4-b2f32c8d6571 on hv-cinder-79760 Jul 25 23:13:13.983440 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-dfac58d8-10ec-4a1d-9357-cfa234d06b78 req-69014925-de47-412f-9093-1bf623b6e6e7 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034995 Jul 25 23:13:13.984057 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 454/905] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:13:14.318168 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-f3825574-d7ce-43e4-8d5a-7ec70f9ff905 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:14.318752 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-f3825574-d7ce-43e4-8d5a-7ec70f9ff905 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] [instance: 94f37847-b0bb-49f3-85b4-b2f32c8d6571] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:14.321506 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=4 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:13:14.327172 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f3825574-d7ce-43e4-8d5a-7ec70f9ff905 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:14.327609 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f3825574-d7ce-43e4-8d5a-7ec70f9ff905 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:14.328396 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f3825574-d7ce-43e4-8d5a-7ec70f9ff905 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:14.329017 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f3825574-d7ce-43e4-8d5a-7ec70f9ff905 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:14.331955 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=63 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:13:14.532119 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-f3825574-d7ce-43e4-8d5a-7ec70f9ff905 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec27525586534109b2a6cb617a3d6378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520dc1ffe9040bc969cbc3b00052503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:13:14.539998 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-f3825574-d7ce-43e4-8d5a-7ec70f9ff905 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] 10.222.0.55 "GET /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571" status: 200 len: 1312 microversion: 2.1 time: 0.225756 Jul 25 23:13:14.540569 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 452/906] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:13:14 2022] GET /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571 => generated 1312 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:13:15.562637 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-333a722e-2074-40b6-bdc4-c880a0b48934 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:15.563329 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-333a722e-2074-40b6-bdc4-c880a0b48934 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] [instance: 94f37847-b0bb-49f3-85b4-b2f32c8d6571] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:15.570819 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-333a722e-2074-40b6-bdc4-c880a0b48934 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:15.571263 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-333a722e-2074-40b6-bdc4-c880a0b48934 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:15.572027 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-333a722e-2074-40b6-bdc4-c880a0b48934 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:15.572464 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-333a722e-2074-40b6-bdc4-c880a0b48934 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:15.703092 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-333a722e-2074-40b6-bdc4-c880a0b48934 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec27525586534109b2a6cb617a3d6378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520dc1ffe9040bc969cbc3b00052503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:13:15.710564 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-333a722e-2074-40b6-bdc4-c880a0b48934 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] 10.222.0.55 "GET /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571" status: 200 len: 1312 microversion: 2.1 time: 0.152619 Jul 25 23:13:15.711232 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 455/907] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:13:15 2022] GET /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571 => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:13:16.731496 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-43d07ca3-d29a-4f11-b038-9813370f752e tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:16.732104 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-43d07ca3-d29a-4f11-b038-9813370f752e tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] [instance: 94f37847-b0bb-49f3-85b4-b2f32c8d6571] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:16.738583 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-43d07ca3-d29a-4f11-b038-9813370f752e tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:16.739060 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-43d07ca3-d29a-4f11-b038-9813370f752e tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:16.739830 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-43d07ca3-d29a-4f11-b038-9813370f752e tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:16.740271 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-43d07ca3-d29a-4f11-b038-9813370f752e tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:16.875350 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-43d07ca3-d29a-4f11-b038-9813370f752e tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec27525586534109b2a6cb617a3d6378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520dc1ffe9040bc969cbc3b00052503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:13:16.883560 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-43d07ca3-d29a-4f11-b038-9813370f752e tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] 10.222.0.55 "GET /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571" status: 200 len: 1312 microversion: 2.1 time: 0.155902 Jul 25 23:13:16.884119 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 453/908] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:13:16 2022] GET /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571 => generated 1312 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:13:17.904753 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4ecf88fa-d00a-49d7-b230-e14dc8c0b92e tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:17.905385 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4ecf88fa-d00a-49d7-b230-e14dc8c0b92e tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] [instance: 94f37847-b0bb-49f3-85b4-b2f32c8d6571] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:17.911868 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4ecf88fa-d00a-49d7-b230-e14dc8c0b92e tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:17.912321 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4ecf88fa-d00a-49d7-b230-e14dc8c0b92e tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:17.913081 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4ecf88fa-d00a-49d7-b230-e14dc8c0b92e tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:17.914058 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4ecf88fa-d00a-49d7-b230-e14dc8c0b92e tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:18.042466 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4ecf88fa-d00a-49d7-b230-e14dc8c0b92e tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec27525586534109b2a6cb617a3d6378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520dc1ffe9040bc969cbc3b00052503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:13:18.049789 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4ecf88fa-d00a-49d7-b230-e14dc8c0b92e tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] 10.222.0.55 "GET /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571" status: 200 len: 1312 microversion: 2.1 time: 0.148935 Jul 25 23:13:18.050345 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 456/909] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:13:17 2022] GET /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571 => generated 1312 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:13:19.071301 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-66f1b43f-cd10-4b03-96d5-347cba08b4e4 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:19.071830 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-66f1b43f-cd10-4b03-96d5-347cba08b4e4 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] [instance: 94f37847-b0bb-49f3-85b4-b2f32c8d6571] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:19.078413 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-66f1b43f-cd10-4b03-96d5-347cba08b4e4 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:19.078859 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-66f1b43f-cd10-4b03-96d5-347cba08b4e4 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:19.079615 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-66f1b43f-cd10-4b03-96d5-347cba08b4e4 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:19.080048 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-66f1b43f-cd10-4b03-96d5-347cba08b4e4 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:19.209643 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-66f1b43f-cd10-4b03-96d5-347cba08b4e4 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec27525586534109b2a6cb617a3d6378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520dc1ffe9040bc969cbc3b00052503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:13:19.217860 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-66f1b43f-cd10-4b03-96d5-347cba08b4e4 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] 10.222.0.55 "GET /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571" status: 200 len: 1312 microversion: 2.1 time: 0.150549 Jul 25 23:13:19.218436 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 454/910] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:13:19 2022] GET /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571 => generated 1312 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:13:20.240668 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-8fe16bc7-23ba-406a-9b78-c81554d11ca7 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:20.241376 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-8fe16bc7-23ba-406a-9b78-c81554d11ca7 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] [instance: 94f37847-b0bb-49f3-85b4-b2f32c8d6571] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:20.244925 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=2 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:13:20.248629 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8fe16bc7-23ba-406a-9b78-c81554d11ca7 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:20.249069 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8fe16bc7-23ba-406a-9b78-c81554d11ca7 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:20.249863 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8fe16bc7-23ba-406a-9b78-c81554d11ca7 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:20.250288 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8fe16bc7-23ba-406a-9b78-c81554d11ca7 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:20.403345 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-8fe16bc7-23ba-406a-9b78-c81554d11ca7 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec27525586534109b2a6cb617a3d6378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520dc1ffe9040bc969cbc3b00052503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:13:20.411480 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-8fe16bc7-23ba-406a-9b78-c81554d11ca7 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] 10.222.0.55 "GET /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571" status: 200 len: 1312 microversion: 2.1 time: 0.174886 Jul 25 23:13:20.413837 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 457/911] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:13:20 2022] GET /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571 => generated 1312 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:13:20.755002 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-a61db41b-f14f-459c-a81e-0901d1bb9064 req-16762841-6538-4006-ba61-a11857c5c695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94f37847-b0bb-49f3-85b4-b2f32c8d6571", "name": "network-vif-plugged", "status": "completed", "tag": "33e226ab-f435-4647-9cb6-cbe108ed6b77"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:13:20.763125 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell0:SELECT=2 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:13:20.764189 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell0:SELECT=6 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:13:20.771169 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-a61db41b-f14f-459c-a81e-0901d1bb9064 req-16762841-6538-4006-ba61-a11857c5c695 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:20.773093 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-a61db41b-f14f-459c-a81e-0901d1bb9064 req-16762841-6538-4006-ba61-a11857c5c695 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:20.782892 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-a61db41b-f14f-459c-a81e-0901d1bb9064 req-16762841-6538-4006-ba61-a11857c5c695 service nova] Creating event network-vif-plugged:33e226ab-f435-4647-9cb6-cbe108ed6b77 for instance 94f37847-b0bb-49f3-85b4-b2f32c8d6571 on hv-cinder-79760 Jul 25 23:13:20.787855 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-a61db41b-f14f-459c-a81e-0901d1bb9064 req-16762841-6538-4006-ba61-a11857c5c695 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037247 Jul 25 23:13:20.789012 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 455/912] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:13:21.434880 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6f295e66-75ae-4975-857c-f69aaa460dc2 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:21.435423 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6f295e66-75ae-4975-857c-f69aaa460dc2 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] [instance: 94f37847-b0bb-49f3-85b4-b2f32c8d6571] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:21.441989 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6f295e66-75ae-4975-857c-f69aaa460dc2 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:21.442437 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6f295e66-75ae-4975-857c-f69aaa460dc2 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:21.443199 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6f295e66-75ae-4975-857c-f69aaa460dc2 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:21.443637 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6f295e66-75ae-4975-857c-f69aaa460dc2 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:21.574059 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6f295e66-75ae-4975-857c-f69aaa460dc2 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec27525586534109b2a6cb617a3d6378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520dc1ffe9040bc969cbc3b00052503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:13:21.581384 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6f295e66-75ae-4975-857c-f69aaa460dc2 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] 10.222.0.55 "GET /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571" status: 200 len: 1312 microversion: 2.1 time: 0.150445 Jul 25 23:13:21.581980 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 458/913] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:13:21 2022] GET /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571 => generated 1312 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:13:22.603945 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-83de02ee-4800-4c2c-8e7c-6e85f1a67266 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:22.604636 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-83de02ee-4800-4c2c-8e7c-6e85f1a67266 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] [instance: 94f37847-b0bb-49f3-85b4-b2f32c8d6571] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:22.611502 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-83de02ee-4800-4c2c-8e7c-6e85f1a67266 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:22.611944 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-83de02ee-4800-4c2c-8e7c-6e85f1a67266 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:22.612696 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-83de02ee-4800-4c2c-8e7c-6e85f1a67266 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:22.613154 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-83de02ee-4800-4c2c-8e7c-6e85f1a67266 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:22.743559 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-83de02ee-4800-4c2c-8e7c-6e85f1a67266 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec27525586534109b2a6cb617a3d6378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520dc1ffe9040bc969cbc3b00052503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:13:22.750959 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-83de02ee-4800-4c2c-8e7c-6e85f1a67266 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] 10.222.0.55 "GET /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571" status: 200 len: 1312 microversion: 2.1 time: 0.152265 Jul 25 23:13:22.751521 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 456/914] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:13:22 2022] GET /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571 => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:13:23.772011 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4aecc1a4-0ea4-438f-86c9-8057cd919d9e tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:23.772615 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4aecc1a4-0ea4-438f-86c9-8057cd919d9e tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] [instance: 94f37847-b0bb-49f3-85b4-b2f32c8d6571] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:23.779741 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4aecc1a4-0ea4-438f-86c9-8057cd919d9e tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:23.780193 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4aecc1a4-0ea4-438f-86c9-8057cd919d9e tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:23.780953 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4aecc1a4-0ea4-438f-86c9-8057cd919d9e tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:23.781410 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4aecc1a4-0ea4-438f-86c9-8057cd919d9e tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:23.910538 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4aecc1a4-0ea4-438f-86c9-8057cd919d9e tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec27525586534109b2a6cb617a3d6378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520dc1ffe9040bc969cbc3b00052503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:13:23.918074 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4aecc1a4-0ea4-438f-86c9-8057cd919d9e tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] 10.222.0.55 "GET /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571" status: 200 len: 1461 microversion: 2.1 time: 0.149906 Jul 25 23:13:23.918627 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 459/915] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:13:23 2022] GET /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571 => generated 1461 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:13:23.962726 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-7eb2aa8e-cdbf-4452-829b-4fe00df4ea7b tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:23.963217 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-7eb2aa8e-cdbf-4452-829b-4fe00df4ea7b tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] [instance: 94f37847-b0bb-49f3-85b4-b2f32c8d6571] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:23.969721 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7eb2aa8e-cdbf-4452-829b-4fe00df4ea7b tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:23.970166 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7eb2aa8e-cdbf-4452-829b-4fe00df4ea7b tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:23.970924 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7eb2aa8e-cdbf-4452-829b-4fe00df4ea7b tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:23.971359 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7eb2aa8e-cdbf-4452-829b-4fe00df4ea7b tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:23.995578 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-7eb2aa8e-cdbf-4452-829b-4fe00df4ea7b tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] [instance: 94f37847-b0bb-49f3-85b4-b2f32c8d6571] Going to try to terminate instance {{(pid=118409) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 23:13:24.247324 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-7eb2aa8e-cdbf-4452-829b-4fe00df4ea7b tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] 10.222.0.55 "DELETE /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571" status: 204 len: 0 microversion: 2.1 time: 0.288752 Jul 25 23:13:24.247833 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 457/916] 10.222.0.55 () {58 vars in 1239 bytes} [Mon Jul 25 23:13:23 2022] DELETE /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 25 23:13:24.255941 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-3a3c1245-8acb-4acd-8e36-d5d147fc940b tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:24.256567 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-3a3c1245-8acb-4acd-8e36-d5d147fc940b tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] [instance: 94f37847-b0bb-49f3-85b4-b2f32c8d6571] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:24.263484 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3a3c1245-8acb-4acd-8e36-d5d147fc940b tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:24.263929 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3a3c1245-8acb-4acd-8e36-d5d147fc940b tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:24.264711 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3a3c1245-8acb-4acd-8e36-d5d147fc940b tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:24.265169 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3a3c1245-8acb-4acd-8e36-d5d147fc940b tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:24.398879 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-3a3c1245-8acb-4acd-8e36-d5d147fc940b tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec27525586534109b2a6cb617a3d6378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520dc1ffe9040bc969cbc3b00052503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:13:24.406510 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-3a3c1245-8acb-4acd-8e36-d5d147fc940b tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] 10.222.0.55 "GET /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571" status: 200 len: 1467 microversion: 2.1 time: 0.154413 Jul 25 23:13:24.407069 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 460/917] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:13:24 2022] GET /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571 => generated 1467 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:13:25.428606 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-9a02930c-a864-443c-90f7-6d79c5b029ac tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:25.429839 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-9a02930c-a864-443c-90f7-6d79c5b029ac tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] [instance: 94f37847-b0bb-49f3-85b4-b2f32c8d6571] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:25.436315 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9a02930c-a864-443c-90f7-6d79c5b029ac tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:25.436761 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9a02930c-a864-443c-90f7-6d79c5b029ac tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:25.437550 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9a02930c-a864-443c-90f7-6d79c5b029ac tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:25.437982 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9a02930c-a864-443c-90f7-6d79c5b029ac tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:25.566935 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-9a02930c-a864-443c-90f7-6d79c5b029ac tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec27525586534109b2a6cb617a3d6378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520dc1ffe9040bc969cbc3b00052503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:13:25.575381 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-9a02930c-a864-443c-90f7-6d79c5b029ac tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] 10.222.0.55 "GET /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571" status: 200 len: 1467 microversion: 2.1 time: 0.151023 Jul 25 23:13:25.575929 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 458/918] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:13:25 2022] GET /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571 => generated 1467 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:13:26.309681 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-863435f9-7593-48dc-8943-eb307e264e73 req-99c4aaec-5b2e-41c7-a715-9b81b836bc04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94f37847-b0bb-49f3-85b4-b2f32c8d6571", "name": "network-vif-deleted", "tag": "33e226ab-f435-4647-9cb6-cbe108ed6b77"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:13:26.319952 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-863435f9-7593-48dc-8943-eb307e264e73 req-99c4aaec-5b2e-41c7-a715-9b81b836bc04 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:26.320392 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-863435f9-7593-48dc-8943-eb307e264e73 req-99c4aaec-5b2e-41c7-a715-9b81b836bc04 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:26.332884 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-863435f9-7593-48dc-8943-eb307e264e73 req-99c4aaec-5b2e-41c7-a715-9b81b836bc04 service nova] Creating event network-vif-deleted:33e226ab-f435-4647-9cb6-cbe108ed6b77 for instance 94f37847-b0bb-49f3-85b4-b2f32c8d6571 on hv-cinder-79760 Jul 25 23:13:26.337961 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-863435f9-7593-48dc-8943-eb307e264e73 req-99c4aaec-5b2e-41c7-a715-9b81b836bc04 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031950 Jul 25 23:13:26.342757 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 461/919] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:13:26.598764 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-2c5caad7-fada-4489-b624-a3bca09ee109 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:26.604957 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-2c5caad7-fada-4489-b624-a3bca09ee109 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] [instance: 94f37847-b0bb-49f3-85b4-b2f32c8d6571] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:26.609448 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2c5caad7-fada-4489-b624-a3bca09ee109 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:26.609902 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2c5caad7-fada-4489-b624-a3bca09ee109 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:26.610687 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2c5caad7-fada-4489-b624-a3bca09ee109 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:26.611148 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2c5caad7-fada-4489-b624-a3bca09ee109 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:26.687463 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-2c5caad7-fada-4489-b624-a3bca09ee109 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ec27525586534109b2a6cb617a3d6378', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3520dc1ffe9040bc969cbc3b00052503', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:13:26.695860 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-2c5caad7-fada-4489-b624-a3bca09ee109 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] 10.222.0.55 "GET /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571" status: 200 len: 1297 microversion: 2.1 time: 0.102053 Jul 25 23:13:26.696424 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 459/920] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:13:26 2022] GET /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571 => generated 1297 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:13:27.717985 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-2363ce45-9090-4857-9ff8-9e7bad40cab5 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:27.718688 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-2363ce45-9090-4857-9ff8-9e7bad40cab5 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] [instance: 94f37847-b0bb-49f3-85b4-b2f32c8d6571] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:27.725026 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2363ce45-9090-4857-9ff8-9e7bad40cab5 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:27.725521 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2363ce45-9090-4857-9ff8-9e7bad40cab5 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:27.726376 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2363ce45-9090-4857-9ff8-9e7bad40cab5 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:27.726816 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-2363ce45-9090-4857-9ff8-9e7bad40cab5 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:27.739847 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-2363ce45-9090-4857-9ff8-9e7bad40cab5 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] HTTP exception thrown: Instance 94f37847-b0bb-49f3-85b4-b2f32c8d6571 could not be found. Jul 25 23:13:27.741618 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-2363ce45-9090-4857-9ff8-9e7bad40cab5 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Request method failure captured: Jul 25 23:13:27.741618 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571 HTTP/1.1 Jul 25 23:13:27.741618 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 25 23:13:27.741618 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 25 23:13:27.741618 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Connection: close Jul 25 23:13:27.741618 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 25 23:13:27.741618 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 25 23:13:27.741618 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Host: 10.222.0.55 Jul 25 23:13:27.741618 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 25 23:13:27.741618 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.10 Jul 25 23:13:27.741618 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABi3yODVG3cr8Fa-CtuTPoSYQY44q66cFrLos0GFg90GA34XqzCfdogAGHIncIZVBaGIWThCRAGg1GYaWLDr68Lh0O9LuNrr_6oLkjsvt-TRUYgvwRD8IJ5YG0XenkhOTeXeyKrqPSc14In_13T5FrDbLaavSdCdsEOKVCn5hdPSLsaHn4 Jul 25 23:13:27.741618 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 25 23:13:27.741618 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 25 23:13:27.741618 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 25 23:13:27.741618 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 25 23:13:27.741618 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 25 23:13:27.741618 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 25 23:13:27.741618 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Id: 3520dc1ffe9040bc969cbc3b00052503 Jul 25 23:13:27.741618 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-VolumesNegativeTest-634330555 Jul 25 23:13:27.741618 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Role: reader,member Jul 25 23:13:27.741618 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Roles: reader,member Jul 25 23:13:27.743246 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3520dc1ffe9040bc969cbc3b00052503"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/3520dc1ffe9040bc969cbc3b00052503"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_3520dc1ffe9040bc969cbc3b00052503", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/3520dc1ffe9040bc969cbc3b00052503"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:13:27.743246 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-VolumesNegativeTest-634330555 Jul 25 23:13:27.743246 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Id: 3520dc1ffe9040bc969cbc3b00052503 Jul 25 23:13:27.743246 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-VolumesNegativeTest-634330555 Jul 25 23:13:27.743246 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User: tempest-VolumesNegativeTest-634330555-project Jul 25 23:13:27.743246 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 25 23:13:27.743246 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 25 23:13:27.743246 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Id: ec27525586534109b2a6cb617a3d6378 Jul 25 23:13:27.743246 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-VolumesNegativeTest-634330555-project Jul 25 23:13:27.743246 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: method: > Jul 25 23:13:27.743246 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: exception: Instance 94f37847-b0bb-49f3-85b4-b2f32c8d6571 could not be found. Jul 25 23:13:27.743246 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: action_args: {'id': '94f37847-b0bb-49f3-85b4-b2f32c8d6571'} Jul 25 23:13:27.744091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:13:27.744091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:13:27.744091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:13:27.744091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:13:27.744091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:13:27.744091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:13:27.744091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:13:27.744091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:13:27.744091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:13:27.744091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:13:27.744091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94f37847-b0bb-49f3-85b4-b2f32c8d6571 could not be found. Jul 25 23:13:27.744091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:13:27.744091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:13:27.744091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:13:27.744091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:13:27.744091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:13:27.744091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:13:27.744091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:13:27.744091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:13:27.744091 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:13:27.745437 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:13:27.745437 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 23:13:27.745437 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 23:13:27.745437 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:13:27.745437 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:13:27.745437 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:13:27.745437 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:13:27.745437 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94f37847-b0bb-49f3-85b4-b2f32c8d6571 could not be found. Jul 25 23:13:27.745437 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:13:27.745437 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:13:27.745437 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:13:27.745437 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:13:27.745437 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:13:27.745437 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:13:27.745437 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:13:27.745437 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:13:27.745437 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94f37847-b0bb-49f3-85b4-b2f32c8d6571 could not be found. Jul 25 23:13:27.745437 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:13:27.746596 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-2363ce45-9090-4857-9ff8-9e7bad40cab5 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] Returning 404 to user: Instance 94f37847-b0bb-49f3-85b4-b2f32c8d6571 could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:13:27.746596 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-2363ce45-9090-4857-9ff8-9e7bad40cab5 tempest-VolumesNegativeTest-634330555 tempest-VolumesNegativeTest-634330555-project] 10.222.0.55 "GET /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571" status: 404 len: 111 microversion: 2.1 time: 0.029895 Jul 25 23:13:27.746596 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 462/921] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:13:27 2022] GET /compute/v2.1/servers/94f37847-b0bb-49f3-85b4-b2f32c8d6571 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:13:38.456874 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-63fd8193-3a87-4207-b888-ce44ebf7a627 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:38.457405 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-63fd8193-3a87-4207-b888-ce44ebf7a627 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 6da72d7b-eb7f-4135-97e0-49f603ac903d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:38.459570 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:13:38.460255 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:13:38.465688 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-63fd8193-3a87-4207-b888-ce44ebf7a627 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:38.507226 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-63fd8193-3a87-4207-b888-ce44ebf7a627 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:38.507226 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-63fd8193-3a87-4207-b888-ce44ebf7a627 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:38.507226 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-63fd8193-3a87-4207-b888-ce44ebf7a627 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:38.507226 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-63fd8193-3a87-4207-b888-ce44ebf7a627 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d/ips" status: 200 len: 149 microversion: 2.1 time: 0.037647 Jul 25 23:13:38.507595 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 460/922] 10.222.0.55 () {58 vars in 1248 bytes} [Mon Jul 25 23:13:38 2022] GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:13:38.517442 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-ad09052a-1632-481c-a812-8100eab28feb tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "01ce251a-a79d-432b-8c60-daa56ce1a442"}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:13:38.519732 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-ad09052a-1632-481c-a812-8100eab28feb tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 6da72d7b-eb7f-4135-97e0-49f603ac903d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:38.522475 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=17 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:13:38.523110 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=41 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:13:38.529689 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ad09052a-1632-481c-a812-8100eab28feb tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:38.530139 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ad09052a-1632-481c-a812-8100eab28feb tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:38.530910 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ad09052a-1632-481c-a812-8100eab28feb tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:38.531347 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-ad09052a-1632-481c-a812-8100eab28feb tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:38.614489 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-ad09052a-1632-481c-a812-8100eab28feb tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] HTTP exception thrown: Invalid volume: volume 01ce251a-a79d-432b-8c60-daa56ce1a442 is already attached to instances: d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf Jul 25 23:13:38.616132 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-ad09052a-1632-481c-a812-8100eab28feb tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Request method failure captured: Jul 25 23:13:38.616132 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: request: POST /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d/os-volume_attachments HTTP/1.1 Jul 25 23:13:38.616132 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 25 23:13:38.616132 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 25 23:13:38.616132 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Connection: close Jul 25 23:13:38.616132 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Length: 74 Jul 25 23:13:38.616132 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 25 23:13:38.616132 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Host: 10.222.0.55 Jul 25 23:13:38.616132 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 25 23:13:38.616132 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.10 Jul 25 23:13:38.616132 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABi3yMnWBF6N7ojia5nXsORomJKEubbLBv0vxCjlfVfsMo4Tn2EFSjvpY4M7xgoUAXGyz8xdNhwjA2Y6j5eYhzQSRo3SbffFPsEnm8ehR5gzh2aHTMOW72yy4L7WJZWPo5TX3ANcF5axUZPg2syZaiRay85nhAKbscEZHRDYy-zr1KSX8Y Jul 25 23:13:38.616132 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 25 23:13:38.616132 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 25 23:13:38.616132 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 25 23:13:38.616132 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 25 23:13:38.616132 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 25 23:13:38.616132 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 25 23:13:38.616132 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Id: bca196a6befb4fae9531dc96a1e58d5f Jul 25 23:13:38.616132 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:13:38.616132 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Role: reader,member Jul 25 23:13:38.616132 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Roles: reader,member Jul 25 23:13:38.617729 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_bca196a6befb4fae9531dc96a1e58d5f", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:13:38.617729 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:13:38.617729 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Id: bca196a6befb4fae9531dc96a1e58d5f Jul 25 23:13:38.617729 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:13:38.617729 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User: tempest-AttachVolumeNegativeTest-920481926-project Jul 25 23:13:38.617729 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 25 23:13:38.617729 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 25 23:13:38.617729 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Id: f54ad4a554de414a80ed03d62c1eb3a5 Jul 25 23:13:38.617729 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-AttachVolumeNegativeTest-920481926-project Jul 25 23:13:38.617729 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Jul 25 23:13:38.617729 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: {"volumeAttachment": {"volumeId": "01ce251a-a79d-432b-8c60-daa56ce1a442"}} Jul 25 23:13:38.617729 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: method: > Jul 25 23:13:38.618638 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: exception: Invalid volume: volume 01ce251a-a79d-432b-8c60-daa56ce1a442 is already attached to instances: d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf Jul 25 23:13:38.618638 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: action_args: {'server_id': '6da72d7b-eb7f-4135-97e0-49f603ac903d', 'body': {'volumeAttachment': {'volumeId': '01ce251a-a79d-432b-8c60-daa56ce1a442'}}} Jul 25 23:13:38.618638 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:13:38.618638 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:13:38.618638 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 23:13:38.618638 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 23:13:38.618638 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 23:13:38.618638 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 23:13:38.618638 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 23:13:38.618638 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 23:13:38.618638 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 25 23:13:38.618638 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 25 23:13:38.618638 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 25 23:13:38.618638 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 25 23:13:38.618638 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 01ce251a-a79d-432b-8c60-daa56ce1a442 is already attached to instances: d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf Jul 25 23:13:38.618638 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:13:38.618638 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:13:38.618638 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:13:38.618638 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:13:38.620260 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:13:38.620260 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:13:38.620260 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:13:38.620260 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:13:38.620260 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:13:38.620260 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:13:38.620260 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 23:13:38.620260 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 23:13:38.620260 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 23:13:38.620260 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 23:13:38.620260 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 23:13:38.620260 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 23:13:38.620260 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 25 23:13:38.620260 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 23:13:38.620260 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 01ce251a-a79d-432b-8c60-daa56ce1a442 is already attached to instances: d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf Jul 25 23:13:38.620260 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:13:38.620260 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:13:38.620260 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:13:38.620260 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:13:38.620260 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:13:38.621732 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:13:38.621732 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:13:38.621732 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:13:38.621732 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 01ce251a-a79d-432b-8c60-daa56ce1a442 is already attached to instances: d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf Jul 25 23:13:38.621732 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:13:38.621732 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-ad09052a-1632-481c-a812-8100eab28feb tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Returning 400 to user: Invalid volume: volume 01ce251a-a79d-432b-8c60-daa56ce1a442 is already attached to instances: d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:13:38.621732 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-ad09052a-1632-481c-a812-8100eab28feb tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "POST /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104441 Jul 25 23:13:38.621732 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 463/923] 10.222.0.55 () {60 vars in 1323 bytes} [Mon Jul 25 23:13:38 2022] POST /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 23:13:38.626870 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-dfd613b2-6ce1-4bb7-8e47-b3fe0e4ed3ec tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:38.627366 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-dfd613b2-6ce1-4bb7-8e47-b3fe0e4ed3ec tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 6da72d7b-eb7f-4135-97e0-49f603ac903d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:38.634169 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-dfd613b2-6ce1-4bb7-8e47-b3fe0e4ed3ec tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:38.634646 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-dfd613b2-6ce1-4bb7-8e47-b3fe0e4ed3ec tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:38.635428 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-dfd613b2-6ce1-4bb7-8e47-b3fe0e4ed3ec tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:38.635860 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-dfd613b2-6ce1-4bb7-8e47-b3fe0e4ed3ec tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:38.660961 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-dfd613b2-6ce1-4bb7-8e47-b3fe0e4ed3ec tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 6da72d7b-eb7f-4135-97e0-49f603ac903d] Going to try to terminate instance {{(pid=118409) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 23:13:38.939453 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-dfd613b2-6ce1-4bb7-8e47-b3fe0e4ed3ec tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d" status: 204 len: 0 microversion: 2.1 time: 0.316725 Jul 25 23:13:38.940049 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 461/924] 10.222.0.55 () {58 vars in 1239 bytes} [Mon Jul 25 23:13:38 2022] DELETE /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 23:13:38.948966 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-dbc954dd-c930-446f-a767-cb2a6882cc72 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:38.949604 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-dbc954dd-c930-446f-a767-cb2a6882cc72 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 6da72d7b-eb7f-4135-97e0-49f603ac903d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:38.955761 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dbc954dd-c930-446f-a767-cb2a6882cc72 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:38.956211 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dbc954dd-c930-446f-a767-cb2a6882cc72 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:38.956979 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dbc954dd-c930-446f-a767-cb2a6882cc72 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:38.957450 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dbc954dd-c930-446f-a767-cb2a6882cc72 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:39.089338 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-dbc954dd-c930-446f-a767-cb2a6882cc72 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:13:39.097165 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-dbc954dd-c930-446f-a767-cb2a6882cc72 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d" status: 200 len: 1682 microversion: 2.1 time: 0.152858 Jul 25 23:13:39.097744 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 464/925] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:13:38 2022] GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:13:40.119262 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-8dd0f55e-e767-4806-92db-2e8beaf5733e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:40.120093 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-8dd0f55e-e767-4806-92db-2e8beaf5733e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 6da72d7b-eb7f-4135-97e0-49f603ac903d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:40.126502 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8dd0f55e-e767-4806-92db-2e8beaf5733e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:40.126941 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8dd0f55e-e767-4806-92db-2e8beaf5733e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:40.127694 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8dd0f55e-e767-4806-92db-2e8beaf5733e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:40.128148 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8dd0f55e-e767-4806-92db-2e8beaf5733e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:40.258060 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-8dd0f55e-e767-4806-92db-2e8beaf5733e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:13:40.265563 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-8dd0f55e-e767-4806-92db-2e8beaf5733e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d" status: 200 len: 1682 microversion: 2.1 time: 0.150572 Jul 25 23:13:40.266121 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 462/926] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:13:40 2022] GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:13:41.286705 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5c6d924e-ba2e-4a5b-bf6f-155bd285365b tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:41.287257 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-5c6d924e-ba2e-4a5b-bf6f-155bd285365b tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 6da72d7b-eb7f-4135-97e0-49f603ac903d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:41.293994 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5c6d924e-ba2e-4a5b-bf6f-155bd285365b tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:41.294443 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5c6d924e-ba2e-4a5b-bf6f-155bd285365b tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:41.295203 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5c6d924e-ba2e-4a5b-bf6f-155bd285365b tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:41.295636 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5c6d924e-ba2e-4a5b-bf6f-155bd285365b tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:41.430697 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-5c6d924e-ba2e-4a5b-bf6f-155bd285365b tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:13:41.438278 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-5c6d924e-ba2e-4a5b-bf6f-155bd285365b tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d" status: 200 len: 1682 microversion: 2.1 time: 0.155498 Jul 25 23:13:41.438839 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 465/927] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:13:41 2022] GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:13:42.451805 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-0e2b3731-3699-429e-8f45-44ca37847595 req-41702a48-ca7d-4ed4-a856-8f622170fd3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6da72d7b-eb7f-4135-97e0-49f603ac903d", "name": "network-vif-deleted", "tag": "a1475c86-1303-418b-ac04-a925f55290e8"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:13:42.459694 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-75a0e139-367b-4564-8d64-f8cb9f66263d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:42.463934 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-75a0e139-367b-4564-8d64-f8cb9f66263d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 6da72d7b-eb7f-4135-97e0-49f603ac903d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:42.464130 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-0e2b3731-3699-429e-8f45-44ca37847595 req-41702a48-ca7d-4ed4-a856-8f622170fd3e service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:42.464130 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-0e2b3731-3699-429e-8f45-44ca37847595 req-41702a48-ca7d-4ed4-a856-8f622170fd3e service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:42.468748 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-75a0e139-367b-4564-8d64-f8cb9f66263d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:42.469434 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-75a0e139-367b-4564-8d64-f8cb9f66263d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:42.470216 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-75a0e139-367b-4564-8d64-f8cb9f66263d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:42.470663 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-75a0e139-367b-4564-8d64-f8cb9f66263d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:42.475907 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-0e2b3731-3699-429e-8f45-44ca37847595 req-41702a48-ca7d-4ed4-a856-8f622170fd3e service nova] Creating event network-vif-deleted:a1475c86-1303-418b-ac04-a925f55290e8 for instance 6da72d7b-eb7f-4135-97e0-49f603ac903d on hv-cinder-79760 Jul 25 23:13:42.481816 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-0e2b3731-3699-429e-8f45-44ca37847595 req-41702a48-ca7d-4ed4-a856-8f622170fd3e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034523 Jul 25 23:13:42.486569 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 463/928] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:13:42.541042 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-75a0e139-367b-4564-8d64-f8cb9f66263d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:13:42.549991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-75a0e139-367b-4564-8d64-f8cb9f66263d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d" status: 200 len: 1614 microversion: 2.1 time: 0.094031 Jul 25 23:13:42.550721 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 466/929] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:13:42 2022] GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d => generated 1614 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:13:43.573509 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-2465bf3e-8416-49b9-bad8-6ec704839f45 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:43.574314 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-2465bf3e-8416-49b9-bad8-6ec704839f45 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 6da72d7b-eb7f-4135-97e0-49f603ac903d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:43.580512 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2465bf3e-8416-49b9-bad8-6ec704839f45 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:43.580959 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2465bf3e-8416-49b9-bad8-6ec704839f45 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:43.581766 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2465bf3e-8416-49b9-bad8-6ec704839f45 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:43.582205 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2465bf3e-8416-49b9-bad8-6ec704839f45 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:43.650175 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-2465bf3e-8416-49b9-bad8-6ec704839f45 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:13:43.658034 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-2465bf3e-8416-49b9-bad8-6ec704839f45 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d" status: 200 len: 1614 microversion: 2.1 time: 0.089883 Jul 25 23:13:43.658602 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 464/930] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:13:43 2022] GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d => generated 1614 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:13:44.681512 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b96f7372-8bf6-4847-a45a-2b370caf8747 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:44.682099 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b96f7372-8bf6-4847-a45a-2b370caf8747 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 6da72d7b-eb7f-4135-97e0-49f603ac903d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:44.688646 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b96f7372-8bf6-4847-a45a-2b370caf8747 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:44.689098 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b96f7372-8bf6-4847-a45a-2b370caf8747 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:44.690321 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b96f7372-8bf6-4847-a45a-2b370caf8747 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:44.690757 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b96f7372-8bf6-4847-a45a-2b370caf8747 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:44.755622 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b96f7372-8bf6-4847-a45a-2b370caf8747 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:13:44.763762 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b96f7372-8bf6-4847-a45a-2b370caf8747 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d" status: 200 len: 1327 microversion: 2.1 time: 0.086628 Jul 25 23:13:44.764322 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 467/931] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:13:44 2022] GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d => generated 1327 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:13:45.785337 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-364f6eef-4047-4656-a274-f08baa44b221 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:45.785972 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-364f6eef-4047-4656-a274-f08baa44b221 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 6da72d7b-eb7f-4135-97e0-49f603ac903d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:45.793619 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-364f6eef-4047-4656-a274-f08baa44b221 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:45.794066 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-364f6eef-4047-4656-a274-f08baa44b221 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:45.794832 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-364f6eef-4047-4656-a274-f08baa44b221 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:45.795271 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-364f6eef-4047-4656-a274-f08baa44b221 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:45.809217 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.wsgi [None req-364f6eef-4047-4656-a274-f08baa44b221 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] HTTP exception thrown: Instance 6da72d7b-eb7f-4135-97e0-49f603ac903d could not be found. Jul 25 23:13:45.810849 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-364f6eef-4047-4656-a274-f08baa44b221 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Request method failure captured: Jul 25 23:13:45.810849 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: request: GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d HTTP/1.1 Jul 25 23:13:45.810849 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept: application/json Jul 25 23:13:45.810849 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept-Encoding: identity Jul 25 23:13:45.810849 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Connection: close Jul 25 23:13:45.810849 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Length: 0 Jul 25 23:13:45.810849 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Type: application/json Jul 25 23:13:45.810849 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Host: 10.222.0.55 Jul 25 23:13:45.810849 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Openstack-System-Scope: None Jul 25 23:13:45.810849 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: User-Agent: python-urllib3/1.26.10 Jul 25 23:13:45.810849 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Auth-Token: gAAAAABi3yMnWBF6N7ojia5nXsORomJKEubbLBv0vxCjlfVfsMo4Tn2EFSjvpY4M7xgoUAXGyz8xdNhwjA2Y6j5eYhzQSRo3SbffFPsEnm8ehR5gzh2aHTMOW72yy4L7WJZWPo5TX3ANcF5axUZPg2syZaiRay85nhAKbscEZHRDYy-zr1KSX8Y Jul 25 23:13:45.810849 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Id: None Jul 25 23:13:45.810849 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Name: None Jul 25 23:13:45.810849 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Identity-Status: Confirmed Jul 25 23:13:45.810849 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Is-Admin-Project: True Jul 25 23:13:45.810849 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Id: default Jul 25 23:13:45.810849 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Name: Default Jul 25 23:13:45.810849 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Id: bca196a6befb4fae9531dc96a1e58d5f Jul 25 23:13:45.810849 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Name: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:13:45.810849 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Role: reader,member Jul 25 23:13:45.810849 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Roles: reader,member Jul 25 23:13:45.812458 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_bca196a6befb4fae9531dc96a1e58d5f", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:13:45.812458 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:13:45.812458 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Id: bca196a6befb4fae9531dc96a1e58d5f Jul 25 23:13:45.812458 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:13:45.812458 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User: tempest-AttachVolumeNegativeTest-920481926-project Jul 25 23:13:45.812458 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Id: default Jul 25 23:13:45.812458 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Name: Default Jul 25 23:13:45.812458 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Id: f54ad4a554de414a80ed03d62c1eb3a5 Jul 25 23:13:45.812458 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Name: tempest-AttachVolumeNegativeTest-920481926-project Jul 25 23:13:45.812458 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: method: > Jul 25 23:13:45.812458 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: exception: Instance 6da72d7b-eb7f-4135-97e0-49f603ac903d could not be found. Jul 25 23:13:45.812458 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: action_args: {'id': '6da72d7b-eb7f-4135-97e0-49f603ac903d'} Jul 25 23:13:45.813603 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:13:45.813603 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:13:45.813603 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:13:45.813603 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:13:45.813603 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:13:45.813603 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:13:45.813603 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:13:45.813603 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:13:45.813603 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:13:45.813603 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:13:45.813603 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6da72d7b-eb7f-4135-97e0-49f603ac903d could not be found. Jul 25 23:13:45.813603 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:13:45.813603 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:13:45.813603 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:13:45.813603 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:13:45.813603 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:13:45.813603 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:13:45.813603 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:13:45.813603 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:13:45.813603 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:13:45.815149 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:13:45.815149 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 23:13:45.815149 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 23:13:45.815149 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:13:45.815149 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:13:45.815149 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:13:45.815149 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:13:45.815149 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6da72d7b-eb7f-4135-97e0-49f603ac903d could not be found. Jul 25 23:13:45.815149 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:13:45.815149 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:13:45.815149 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:13:45.815149 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:13:45.815149 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:13:45.815149 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:13:45.815149 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:13:45.815149 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:13:45.815149 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6da72d7b-eb7f-4135-97e0-49f603ac903d could not be found. Jul 25 23:13:45.815149 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:13:45.816699 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-364f6eef-4047-4656-a274-f08baa44b221 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Returning 404 to user: Instance 6da72d7b-eb7f-4135-97e0-49f603ac903d could not be found. {{(pid=118409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:13:45.816699 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-364f6eef-4047-4656-a274-f08baa44b221 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d" status: 404 len: 111 microversion: 2.1 time: 0.030817 Jul 25 23:13:45.816699 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 465/932] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:13:45 2022] GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:13:45.820977 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-710a909f-1e8f-4618-9d91-32a875098c63 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '.version_select at 0x7f6226ec4430>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:45.923284 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-710a909f-1e8f-4618-9d91-32a875098c63 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1006213001" status: 202 len: 0 microversion: 2.1 time: 0.105999 Jul 25 23:13:45.923897 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 468/933] 10.222.0.55 () {58 vars in 1221 bytes} [Mon Jul 25 23:13:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1006213001 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 23:13:46.719443 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-c6534223-b55f-49ca-8b9c-392d1e128040 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:46.720006 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-c6534223-b55f-49ca-8b9c-392d1e128040 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:46.726025 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c6534223-b55f-49ca-8b9c-392d1e128040 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:46.726472 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c6534223-b55f-49ca-8b9c-392d1e128040 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:46.727228 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c6534223-b55f-49ca-8b9c-392d1e128040 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:46.727662 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c6534223-b55f-49ca-8b9c-392d1e128040 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:46.807420 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.objects.instance [None req-c6534223-b55f-49ca-8b9c-392d1e128040 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lazy-loading 'services' on Instance uuid d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf {{(pid=118409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 23:13:47.016070 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-c6534223-b55f-49ca-8b9c-392d1e128040 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "DELETE /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf/os-volume_attachments/01ce251a-a79d-432b-8c60-daa56ce1a442" status: 202 len: 0 microversion: 2.1 time: 0.300209 Jul 25 23:13:47.016657 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 466/934] 10.222.0.55 () {58 vars in 1416 bytes} [Mon Jul 25 23:13:46 2022] DELETE /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf/os-volume_attachments/01ce251a-a79d-432b-8c60-daa56ce1a442 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 23:13:47.025911 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4fa0c60c-4d8c-40d8-be82-c6e2436acd0b tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:47.028042 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4fa0c60c-4d8c-40d8-be82-c6e2436acd0b tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:47.034709 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4fa0c60c-4d8c-40d8-be82-c6e2436acd0b tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:47.035463 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4fa0c60c-4d8c-40d8-be82-c6e2436acd0b tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:47.036452 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4fa0c60c-4d8c-40d8-be82-c6e2436acd0b tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:47.037112 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4fa0c60c-4d8c-40d8-be82-c6e2436acd0b tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:47.070135 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4fa0c60c-4d8c-40d8-be82-c6e2436acd0b tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048755 Jul 25 23:13:47.071015 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 469/935] 10.222.0.55 () {58 vars in 1302 bytes} [Mon Jul 25 23:13:47 2022] GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:13:48.084136 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-121a4ca0-2a8a-4ff8-9973-70640ac5c6b2 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:48.086488 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-121a4ca0-2a8a-4ff8-9973-70640ac5c6b2 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:48.093717 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-121a4ca0-2a8a-4ff8-9973-70640ac5c6b2 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:48.094162 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-121a4ca0-2a8a-4ff8-9973-70640ac5c6b2 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:48.094923 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-121a4ca0-2a8a-4ff8-9973-70640ac5c6b2 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:48.095360 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-121a4ca0-2a8a-4ff8-9973-70640ac5c6b2 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:48.124208 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-121a4ca0-2a8a-4ff8-9973-70640ac5c6b2 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044810 Jul 25 23:13:48.124671 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 467/936] 10.222.0.55 () {58 vars in 1302 bytes} [Mon Jul 25 23:13:48 2022] GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:13:49.136029 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-be977221-9a56-4c22-92e5-a213f3fda601 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:49.138515 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-be977221-9a56-4c22-92e5-a213f3fda601 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:49.145363 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-be977221-9a56-4c22-92e5-a213f3fda601 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:49.145812 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-be977221-9a56-4c22-92e5-a213f3fda601 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:49.146612 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-be977221-9a56-4c22-92e5-a213f3fda601 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:49.147048 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-be977221-9a56-4c22-92e5-a213f3fda601 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:49.179311 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-be977221-9a56-4c22-92e5-a213f3fda601 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047408 Jul 25 23:13:49.179874 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 470/937] 10.222.0.55 () {58 vars in 1302 bytes} [Mon Jul 25 23:13:49 2022] GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:13:50.192257 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-095aeb02-4626-435e-9ddb-be07cbafc809 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:50.194857 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-095aeb02-4626-435e-9ddb-be07cbafc809 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:50.202374 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-095aeb02-4626-435e-9ddb-be07cbafc809 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:50.202814 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-095aeb02-4626-435e-9ddb-be07cbafc809 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:50.203568 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-095aeb02-4626-435e-9ddb-be07cbafc809 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:50.203994 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-095aeb02-4626-435e-9ddb-be07cbafc809 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:50.232938 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-095aeb02-4626-435e-9ddb-be07cbafc809 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045225 Jul 25 23:13:50.233506 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 468/938] 10.222.0.55 () {58 vars in 1302 bytes} [Mon Jul 25 23:13:50 2022] GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 25 23:13:50.300416 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c4f14dfd-fbe1-4f44-8231-12fa0cccdbbb tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:50.301139 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c4f14dfd-fbe1-4f44-8231-12fa0cccdbbb tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:50.312739 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c4f14dfd-fbe1-4f44-8231-12fa0cccdbbb tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:50.312739 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c4f14dfd-fbe1-4f44-8231-12fa0cccdbbb tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:50.312739 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c4f14dfd-fbe1-4f44-8231-12fa0cccdbbb tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:50.312739 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c4f14dfd-fbe1-4f44-8231-12fa0cccdbbb tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:50.337454 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c4f14dfd-fbe1-4f44-8231-12fa0cccdbbb tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf] Going to try to terminate instance {{(pid=118410) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 23:13:50.636344 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c4f14dfd-fbe1-4f44-8231-12fa0cccdbbb tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "DELETE /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf" status: 204 len: 0 microversion: 2.1 time: 0.339526 Jul 25 23:13:50.639698 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 471/939] 10.222.0.55 () {58 vars in 1239 bytes} [Mon Jul 25 23:13:50 2022] DELETE /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 23:13:50.646587 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-ce8fef0e-7b27-4327-b518-7486c3cc0fbd tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:50.647224 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-ce8fef0e-7b27-4327-b518-7486c3cc0fbd tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:50.653424 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ce8fef0e-7b27-4327-b518-7486c3cc0fbd tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:50.653880 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ce8fef0e-7b27-4327-b518-7486c3cc0fbd tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:50.654657 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ce8fef0e-7b27-4327-b518-7486c3cc0fbd tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:50.655094 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ce8fef0e-7b27-4327-b518-7486c3cc0fbd tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:50.789227 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-ce8fef0e-7b27-4327-b518-7486c3cc0fbd tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:13:50.801673 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-ce8fef0e-7b27-4327-b518-7486c3cc0fbd tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf" status: 200 len: 1679 microversion: 2.1 time: 0.158881 Jul 25 23:13:50.802271 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 469/940] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:13:50 2022] GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:13:51.825092 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a4840a3f-1abe-4ac4-8c26-67dd0afb0a8c tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:51.825842 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a4840a3f-1abe-4ac4-8c26-67dd0afb0a8c tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:51.832494 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a4840a3f-1abe-4ac4-8c26-67dd0afb0a8c tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:51.832941 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a4840a3f-1abe-4ac4-8c26-67dd0afb0a8c tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:51.833767 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a4840a3f-1abe-4ac4-8c26-67dd0afb0a8c tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:51.834198 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a4840a3f-1abe-4ac4-8c26-67dd0afb0a8c tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:52.147794 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a4840a3f-1abe-4ac4-8c26-67dd0afb0a8c tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:13:52.156630 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a4840a3f-1abe-4ac4-8c26-67dd0afb0a8c tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf" status: 200 len: 1679 microversion: 2.1 time: 0.336339 Jul 25 23:13:52.157269 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 472/941] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:13:51 2022] GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf => generated 1679 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:13:53.149479 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-7b93efd6-33ec-4c29-9b81-acdeed02fb31 req-3928396a-9ace-47d4-9c00-286f4e08d801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf", "name": "network-vif-deleted", "tag": "b8685360-29d7-4321-89d9-cdb5d87c4964"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:13:53.165420 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-7b93efd6-33ec-4c29-9b81-acdeed02fb31 req-3928396a-9ace-47d4-9c00-286f4e08d801 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:53.165859 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-7b93efd6-33ec-4c29-9b81-acdeed02fb31 req-3928396a-9ace-47d4-9c00-286f4e08d801 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:53.178908 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-fd02ad17-35fc-4835-b56b-e618d5ae2316 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:53.179589 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-fd02ad17-35fc-4835-b56b-e618d5ae2316 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:53.189617 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-7b93efd6-33ec-4c29-9b81-acdeed02fb31 req-3928396a-9ace-47d4-9c00-286f4e08d801 service nova] Creating event network-vif-deleted:b8685360-29d7-4321-89d9-cdb5d87c4964 for instance d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf on hv-cinder-79760 Jul 25 23:13:53.193740 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fd02ad17-35fc-4835-b56b-e618d5ae2316 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:53.194423 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fd02ad17-35fc-4835-b56b-e618d5ae2316 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:53.195213 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fd02ad17-35fc-4835-b56b-e618d5ae2316 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:53.196947 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-fd02ad17-35fc-4835-b56b-e618d5ae2316 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:53.197658 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-7b93efd6-33ec-4c29-9b81-acdeed02fb31 req-3928396a-9ace-47d4-9c00-286f4e08d801 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051854 Jul 25 23:13:53.201445 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 470/942] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:13:53.274161 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-fd02ad17-35fc-4835-b56b-e618d5ae2316 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:13:53.284423 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-fd02ad17-35fc-4835-b56b-e618d5ae2316 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf" status: 200 len: 1611 microversion: 2.1 time: 0.108526 Jul 25 23:13:53.288190 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 473/943] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:13:53 2022] GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf => generated 1611 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:13:54.311426 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-ac813abf-0af1-49c7-be40-69f0f6cea5a6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:54.317043 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-ac813abf-0af1-49c7-be40-69f0f6cea5a6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:54.318943 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ac813abf-0af1-49c7-be40-69f0f6cea5a6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:54.319493 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ac813abf-0af1-49c7-be40-69f0f6cea5a6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:54.320331 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ac813abf-0af1-49c7-be40-69f0f6cea5a6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:54.320845 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ac813abf-0af1-49c7-be40-69f0f6cea5a6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:54.336462 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.wsgi [None req-ac813abf-0af1-49c7-be40-69f0f6cea5a6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] HTTP exception thrown: Instance d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf could not be found. Jul 25 23:13:54.338335 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-ac813abf-0af1-49c7-be40-69f0f6cea5a6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Request method failure captured: Jul 25 23:13:54.338335 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: request: GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf HTTP/1.1 Jul 25 23:13:54.338335 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept: application/json Jul 25 23:13:54.338335 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept-Encoding: identity Jul 25 23:13:54.338335 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Connection: close Jul 25 23:13:54.338335 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Length: 0 Jul 25 23:13:54.338335 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Type: application/json Jul 25 23:13:54.338335 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Host: 10.222.0.55 Jul 25 23:13:54.338335 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Openstack-System-Scope: None Jul 25 23:13:54.338335 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: User-Agent: python-urllib3/1.26.10 Jul 25 23:13:54.338335 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Auth-Token: gAAAAABi3yMnWBF6N7ojia5nXsORomJKEubbLBv0vxCjlfVfsMo4Tn2EFSjvpY4M7xgoUAXGyz8xdNhwjA2Y6j5eYhzQSRo3SbffFPsEnm8ehR5gzh2aHTMOW72yy4L7WJZWPo5TX3ANcF5axUZPg2syZaiRay85nhAKbscEZHRDYy-zr1KSX8Y Jul 25 23:13:54.338335 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Id: None Jul 25 23:13:54.338335 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Name: None Jul 25 23:13:54.338335 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Identity-Status: Confirmed Jul 25 23:13:54.338335 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Is-Admin-Project: True Jul 25 23:13:54.338335 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Id: default Jul 25 23:13:54.338335 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Name: Default Jul 25 23:13:54.338335 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Id: bca196a6befb4fae9531dc96a1e58d5f Jul 25 23:13:54.338335 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Name: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:13:54.338335 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Role: reader,member Jul 25 23:13:54.338335 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Roles: reader,member Jul 25 23:13:54.340050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_bca196a6befb4fae9531dc96a1e58d5f", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:13:54.340050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:13:54.340050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Id: bca196a6befb4fae9531dc96a1e58d5f Jul 25 23:13:54.340050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:13:54.340050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User: tempest-AttachVolumeNegativeTest-920481926-project Jul 25 23:13:54.340050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Id: default Jul 25 23:13:54.340050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Name: Default Jul 25 23:13:54.340050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Id: f54ad4a554de414a80ed03d62c1eb3a5 Jul 25 23:13:54.340050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Name: tempest-AttachVolumeNegativeTest-920481926-project Jul 25 23:13:54.340050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: method: > Jul 25 23:13:54.340050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: exception: Instance d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf could not be found. Jul 25 23:13:54.340050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: action_args: {'id': 'd61a91a5-1d8c-4452-bb6f-de7ebd5d56bf'} Jul 25 23:13:54.340933 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:13:54.340933 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:13:54.340933 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:13:54.340933 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:13:54.340933 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:13:54.340933 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:13:54.340933 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:13:54.340933 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:13:54.340933 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:13:54.340933 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:13:54.340933 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf could not be found. Jul 25 23:13:54.340933 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:13:54.340933 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:13:54.340933 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:13:54.340933 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:13:54.340933 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:13:54.340933 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:13:54.340933 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:13:54.340933 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:13:54.340933 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:13:54.342522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:13:54.342522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 23:13:54.342522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 23:13:54.342522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:13:54.342522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:13:54.342522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:13:54.342522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:13:54.342522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf could not be found. Jul 25 23:13:54.342522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:13:54.342522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:13:54.342522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:13:54.342522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:13:54.342522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:13:54.342522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:13:54.342522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:13:54.342522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:13:54.342522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf could not be found. Jul 25 23:13:54.342522 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:13:54.343860 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-ac813abf-0af1-49c7-be40-69f0f6cea5a6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Returning 404 to user: Instance d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf could not be found. {{(pid=118409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:13:54.343860 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-ac813abf-0af1-49c7-be40-69f0f6cea5a6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf" status: 404 len: 111 microversion: 2.1 time: 0.034584 Jul 25 23:13:54.343860 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 471/944] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:13:54 2022] GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:13:54.350540 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-61fd4e27-cbb9-42a4-932d-22f1bb65c0a2 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '.version_select at 0x7f6226ec49d0>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:54.428907 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-61fd4e27-cbb9-42a4-932d-22f1bb65c0a2 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-344773280" status: 202 len: 0 microversion: 2.1 time: 0.083148 Jul 25 23:13:54.429513 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 474/945] 10.222.0.55 () {58 vars in 1218 bytes} [Mon Jul 25 23:13:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-344773280 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 23:13:55.210239 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-9226b0ff-fa57-4fa5-ad5d-1e067c439a49 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Action: 'create', calling method: .version_select at 0x7f6226e8f160>, body: {"keypair": {"name": "tempest-keypair-268320819", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJi7g47M1lbm4i0PoQu0eM4DyDxY0O7sYvFz1QVFnUTXyrm7Hz9aNZT5pOv2OzClK+8K8EPljHRmy1CckYXcOEGBl0wnX/Jo9z6hUot7aL3jtWMNJYpJclbmlnpl2/mxQ=="}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:13:55.226487 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-9226b0ff-fa57-4fa5-ad5d-1e067c439a49 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Getting quotas for project bca196a6befb4fae9531dc96a1e58d5f. Resources: {'key_pairs'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 23:13:55.230393 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-9226b0ff-fa57-4fa5-ad5d-1e067c439a49 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Getting quotas for user f54ad4a554de414a80ed03d62c1eb3a5 and project bca196a6befb4fae9531dc96a1e58d5f. Resources: {'key_pairs'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 23:13:55.323118 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-9226b0ff-fa57-4fa5-ad5d-1e067c439a49 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.116764 Jul 25 23:13:55.324228 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 472/946] 10.222.0.55 () {60 vars in 1159 bytes} [Mon Jul 25 23:13:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:13:57.651752 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f2a91be3-31e0-4e11-b2b8-6fbdbe335431 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1505009693", "imageRef": "8e9f3265-0fdf-483a-8e2e-41d408f5f0e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "61b90c6f-f28d-4718-a9dc-fcf196e75d09"}], "security_groups": [{"name": "tempest-securitygroup--438340792"}], "key_name": "tempest-keypair-268320819", "user_data": "}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:13:57.758352 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.network.neutron [None req-f2a91be3-31e0-4e11-b2b8-6fbdbe335431 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] validate_networks() for [('61b90c6f-f28d-4718-a9dc-fcf196e75d09', None, None, None, None, None)] {{(pid=118410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 23:13:58.377483 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-f2a91be3-31e0-4e11-b2b8-6fbdbe335431 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Flavor limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 23:13:58.377910 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-f2a91be3-31e0-4e11-b2b8-6fbdbe335431 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Image limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 23:13:58.378385 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-f2a91be3-31e0-4e11-b2b8-6fbdbe335431 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Flavor pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 23:13:58.378795 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-f2a91be3-31e0-4e11-b2b8-6fbdbe335431 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Image pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 23:13:58.379205 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-f2a91be3-31e0-4e11-b2b8-6fbdbe335431 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 23:13:58.388454 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f2a91be3-31e0-4e11-b2b8-6fbdbe335431 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:58.388901 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f2a91be3-31e0-4e11-b2b8-6fbdbe335431 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:58.389744 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f2a91be3-31e0-4e11-b2b8-6fbdbe335431 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:58.390183 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f2a91be3-31e0-4e11-b2b8-6fbdbe335431 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:58.407094 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-f2a91be3-31e0-4e11-b2b8-6fbdbe335431 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Getting quotas for project bca196a6befb4fae9531dc96a1e58d5f. Resources: {'instances', 'cores', 'ram'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 23:13:58.411065 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-f2a91be3-31e0-4e11-b2b8-6fbdbe335431 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Getting quotas for user f54ad4a554de414a80ed03d62c1eb3a5 and project bca196a6befb4fae9531dc96a1e58d5f. Resources: {'instances', 'cores', 'ram'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 23:13:58.422339 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f2a91be3-31e0-4e11-b2b8-6fbdbe335431 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Going to run 1 instances... {{(pid=118410) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 23:13:58.424580 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f2a91be3-31e0-4e11-b2b8-6fbdbe335431 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d442d7e2-afaf-4db1-8130-b13d2f5cc7e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e9f3265-0fdf-483a-8e2e-41d408f5f0e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 23:13:58.587060 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f2a91be3-31e0-4e11-b2b8-6fbdbe335431 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.939892 Jul 25 23:13:58.587707 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 475/947] 10.222.0.55 () {60 vars in 1147 bytes} [Mon Jul 25 23:13:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 23:13:58.600053 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-481265cd-2509-472e-9e70-6c1ecbe2ab41 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:58.600660 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-481265cd-2509-472e-9e70-6c1ecbe2ab41 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d442d7e2-afaf-4db1-8130-b13d2f5cc7e9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:58.846690 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-481265cd-2509-472e-9e70-6c1ecbe2ab41 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:13:58.853484 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-481265cd-2509-472e-9e70-6c1ecbe2ab41 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9" status: 200 len: 1241 microversion: 2.1 time: 0.257842 Jul 25 23:13:58.854038 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 473/948] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:13:58 2022] GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 => generated 1241 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:13:59.875893 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-9a7b93fa-5da4-454b-86c2-c3c06b727f97 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:13:59.876577 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-9a7b93fa-5da4-454b-86c2-c3c06b727f97 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d442d7e2-afaf-4db1-8130-b13d2f5cc7e9] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:13:59.882961 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9a7b93fa-5da4-454b-86c2-c3c06b727f97 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:59.883496 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9a7b93fa-5da4-454b-86c2-c3c06b727f97 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:59.884343 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9a7b93fa-5da4-454b-86c2-c3c06b727f97 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:13:59.884849 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9a7b93fa-5da4-454b-86c2-c3c06b727f97 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:13:59.950974 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9a7b93fa-5da4-454b-86c2-c3c06b727f97 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:13:59.958531 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-9a7b93fa-5da4-454b-86c2-c3c06b727f97 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9" status: 200 len: 1237 microversion: 2.1 time: 0.087393 Jul 25 23:13:59.959090 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 476/949] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:13:59 2022] GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 => generated 1237 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:14:00.980088 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-64ad3eed-c15c-4b86-b2e0-b4ab5b376d1d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:14:00.981426 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-64ad3eed-c15c-4b86-b2e0-b4ab5b376d1d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d442d7e2-afaf-4db1-8130-b13d2f5cc7e9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:14:00.988097 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-64ad3eed-c15c-4b86-b2e0-b4ab5b376d1d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:00.988559 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-64ad3eed-c15c-4b86-b2e0-b4ab5b376d1d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:00.989359 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-64ad3eed-c15c-4b86-b2e0-b4ab5b376d1d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:00.989817 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-64ad3eed-c15c-4b86-b2e0-b4ab5b376d1d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:01.063040 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-64ad3eed-c15c-4b86-b2e0-b4ab5b376d1d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:14:01.070684 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-64ad3eed-c15c-4b86-b2e0-b4ab5b376d1d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9" status: 200 len: 1299 microversion: 2.1 time: 0.094513 Jul 25 23:14:01.071276 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 474/950] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:14:00 2022] GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 => generated 1299 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:14:02.092529 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-41c6f04f-3adf-4e97-bcc8-fe0025ee68b6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:14:02.093138 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-41c6f04f-3adf-4e97-bcc8-fe0025ee68b6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d442d7e2-afaf-4db1-8130-b13d2f5cc7e9] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:14:02.099743 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-41c6f04f-3adf-4e97-bcc8-fe0025ee68b6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:02.100185 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-41c6f04f-3adf-4e97-bcc8-fe0025ee68b6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:02.100942 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-41c6f04f-3adf-4e97-bcc8-fe0025ee68b6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:02.101403 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-41c6f04f-3adf-4e97-bcc8-fe0025ee68b6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:02.235236 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-41c6f04f-3adf-4e97-bcc8-fe0025ee68b6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:14:02.242660 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-41c6f04f-3adf-4e97-bcc8-fe0025ee68b6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9" status: 200 len: 1366 microversion: 2.1 time: 0.154560 Jul 25 23:14:02.243230 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 477/951] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:14:02 2022] GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:14:03.264394 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-0ec4f487-bdc9-44c2-9725-66c70158d126 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:14:03.264941 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-0ec4f487-bdc9-44c2-9725-66c70158d126 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d442d7e2-afaf-4db1-8130-b13d2f5cc7e9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:14:03.271761 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0ec4f487-bdc9-44c2-9725-66c70158d126 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:03.272202 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0ec4f487-bdc9-44c2-9725-66c70158d126 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:03.272984 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0ec4f487-bdc9-44c2-9725-66c70158d126 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:03.273455 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0ec4f487-bdc9-44c2-9725-66c70158d126 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:03.522948 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-0ec4f487-bdc9-44c2-9725-66c70158d126 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:14:03.535021 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-0ec4f487-bdc9-44c2-9725-66c70158d126 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9" status: 200 len: 1366 microversion: 2.1 time: 0.274597 Jul 25 23:14:03.535602 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 475/952] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:14:03 2022] GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 => generated 1366 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:14:04.146783 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-1f1c7cfd-314d-4b93-848d-29353078f098 req-206b9e8e-cdf1-471c-b03d-16a77e8307dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d442d7e2-afaf-4db1-8130-b13d2f5cc7e9", "tag": "f3f3699e-fbf9-46b4-a96e-46959ebc31c3"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:14:04.157749 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-1f1c7cfd-314d-4b93-848d-29353078f098 req-206b9e8e-cdf1-471c-b03d-16a77e8307dc service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:04.158190 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-1f1c7cfd-314d-4b93-848d-29353078f098 req-206b9e8e-cdf1-471c-b03d-16a77e8307dc service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:04.170742 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-1f1c7cfd-314d-4b93-848d-29353078f098 req-206b9e8e-cdf1-471c-b03d-16a77e8307dc service nova] Creating event network-changed:f3f3699e-fbf9-46b4-a96e-46959ebc31c3 for instance d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 on hv-cinder-79760 Jul 25 23:14:04.176213 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-1f1c7cfd-314d-4b93-848d-29353078f098 req-206b9e8e-cdf1-471c-b03d-16a77e8307dc service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033319 Jul 25 23:14:04.176952 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 478/953] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:14:04.556939 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-e55bcd7f-75ac-4ab7-be1a-78806d13ac26 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:14:04.557694 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-e55bcd7f-75ac-4ab7-be1a-78806d13ac26 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d442d7e2-afaf-4db1-8130-b13d2f5cc7e9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:14:04.564667 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e55bcd7f-75ac-4ab7-be1a-78806d13ac26 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:04.565225 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e55bcd7f-75ac-4ab7-be1a-78806d13ac26 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:04.566063 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e55bcd7f-75ac-4ab7-be1a-78806d13ac26 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:04.566589 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e55bcd7f-75ac-4ab7-be1a-78806d13ac26 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:04.788437 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-e55bcd7f-75ac-4ab7-be1a-78806d13ac26 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:14:04.796410 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-e55bcd7f-75ac-4ab7-be1a-78806d13ac26 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9" status: 200 len: 1366 microversion: 2.1 time: 0.243322 Jul 25 23:14:04.796976 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 476/954] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:14:04 2022] GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:14:05.819415 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a635c0e1-c3b9-4c28-9be8-057a3c557b80 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:14:05.820021 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a635c0e1-c3b9-4c28-9be8-057a3c557b80 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d442d7e2-afaf-4db1-8130-b13d2f5cc7e9] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:14:05.826705 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a635c0e1-c3b9-4c28-9be8-057a3c557b80 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:05.827149 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a635c0e1-c3b9-4c28-9be8-057a3c557b80 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:05.827902 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a635c0e1-c3b9-4c28-9be8-057a3c557b80 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:05.828331 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a635c0e1-c3b9-4c28-9be8-057a3c557b80 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:05.956570 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a635c0e1-c3b9-4c28-9be8-057a3c557b80 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:14:05.963952 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a635c0e1-c3b9-4c28-9be8-057a3c557b80 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9" status: 200 len: 1366 microversion: 2.1 time: 0.149281 Jul 25 23:14:05.964517 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 479/955] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:14:05 2022] GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:14:06.985715 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-93e6782a-2722-4fc2-923a-01bd154fb4e3 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:14:06.986346 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-93e6782a-2722-4fc2-923a-01bd154fb4e3 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d442d7e2-afaf-4db1-8130-b13d2f5cc7e9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:14:06.993292 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-93e6782a-2722-4fc2-923a-01bd154fb4e3 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:06.997519 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-93e6782a-2722-4fc2-923a-01bd154fb4e3 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:06.997519 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-93e6782a-2722-4fc2-923a-01bd154fb4e3 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:06.997519 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-93e6782a-2722-4fc2-923a-01bd154fb4e3 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:07.127344 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-93e6782a-2722-4fc2-923a-01bd154fb4e3 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:14:07.134832 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-93e6782a-2722-4fc2-923a-01bd154fb4e3 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9" status: 200 len: 1366 microversion: 2.1 time: 0.153276 Jul 25 23:14:07.135390 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 477/956] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:14:06 2022] GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:14:08.156381 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-d1584ee4-9f14-4f3d-b92e-3c38050b86e6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:14:08.156992 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-d1584ee4-9f14-4f3d-b92e-3c38050b86e6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d442d7e2-afaf-4db1-8130-b13d2f5cc7e9] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:14:08.163440 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d1584ee4-9f14-4f3d-b92e-3c38050b86e6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:08.163889 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d1584ee4-9f14-4f3d-b92e-3c38050b86e6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:08.164653 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d1584ee4-9f14-4f3d-b92e-3c38050b86e6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:08.165084 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-d1584ee4-9f14-4f3d-b92e-3c38050b86e6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:08.295505 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-d1584ee4-9f14-4f3d-b92e-3c38050b86e6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:14:08.302840 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-d1584ee4-9f14-4f3d-b92e-3c38050b86e6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9" status: 200 len: 1366 microversion: 2.1 time: 0.150975 Jul 25 23:14:08.303403 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 480/957] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:14:08 2022] GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:14:09.325022 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-d4936fe7-6c77-4b51-bc2f-738a3865e9f1 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:14:09.327064 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-d4936fe7-6c77-4b51-bc2f-738a3865e9f1 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d442d7e2-afaf-4db1-8130-b13d2f5cc7e9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:14:09.329692 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell0:SELECT=6 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:14:09.330353 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:14:09.335085 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d4936fe7-6c77-4b51-bc2f-738a3865e9f1 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:09.335659 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d4936fe7-6c77-4b51-bc2f-738a3865e9f1 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:09.336587 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d4936fe7-6c77-4b51-bc2f-738a3865e9f1 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:09.337015 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d4936fe7-6c77-4b51-bc2f-738a3865e9f1 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:09.340453 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:14:09.487750 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-d4936fe7-6c77-4b51-bc2f-738a3865e9f1 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:14:09.497494 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-d4936fe7-6c77-4b51-bc2f-738a3865e9f1 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9" status: 200 len: 1366 microversion: 2.1 time: 0.175834 Jul 25 23:14:09.511552 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 478/958] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:14:09 2022] GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:14:09.679995 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-092d5549-22bb-477b-942b-2882212cbdab req-dc79bca8-d7a1-4d1f-a8e9-4ea2fb8a34b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d442d7e2-afaf-4db1-8130-b13d2f5cc7e9", "name": "network-vif-plugged", "status": "completed", "tag": "f3f3699e-fbf9-46b4-a96e-46959ebc31c3"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:14:09.685557 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=2 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:14:09.686230 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=6 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:14:09.687341 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:14:09.692636 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-092d5549-22bb-477b-942b-2882212cbdab req-dc79bca8-d7a1-4d1f-a8e9-4ea2fb8a34b2 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:09.693083 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-092d5549-22bb-477b-942b-2882212cbdab req-dc79bca8-d7a1-4d1f-a8e9-4ea2fb8a34b2 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:09.697560 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:14:09.704690 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-092d5549-22bb-477b-942b-2882212cbdab req-dc79bca8-d7a1-4d1f-a8e9-4ea2fb8a34b2 service nova] Creating event network-vif-plugged:f3f3699e-fbf9-46b4-a96e-46959ebc31c3 for instance d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 on hv-cinder-79760 Jul 25 23:14:09.709625 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-092d5549-22bb-477b-942b-2882212cbdab req-dc79bca8-d7a1-4d1f-a8e9-4ea2fb8a34b2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033311 Jul 25 23:14:09.710844 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 481/959] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:14:10.519208 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-9df3326d-e022-4dab-bc37-29c20725168f tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:14:10.520171 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-9df3326d-e022-4dab-bc37-29c20725168f tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d442d7e2-afaf-4db1-8130-b13d2f5cc7e9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:14:10.529502 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9df3326d-e022-4dab-bc37-29c20725168f tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:10.529953 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9df3326d-e022-4dab-bc37-29c20725168f tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:10.530739 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9df3326d-e022-4dab-bc37-29c20725168f tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:10.531176 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9df3326d-e022-4dab-bc37-29c20725168f tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:10.682064 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-9df3326d-e022-4dab-bc37-29c20725168f tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:14:10.691659 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-9df3326d-e022-4dab-bc37-29c20725168f tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9" status: 200 len: 1366 microversion: 2.1 time: 0.176645 Jul 25 23:14:10.692254 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 479/960] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:14:10 2022] GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:14:11.739996 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-50406b52-4ddf-4568-8b85-b53ed1e421bc tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:14:11.741417 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-50406b52-4ddf-4568-8b85-b53ed1e421bc tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d442d7e2-afaf-4db1-8130-b13d2f5cc7e9] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:14:11.751532 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-50406b52-4ddf-4568-8b85-b53ed1e421bc tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:11.752177 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-50406b52-4ddf-4568-8b85-b53ed1e421bc tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:11.752973 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-50406b52-4ddf-4568-8b85-b53ed1e421bc tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:11.753442 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-50406b52-4ddf-4568-8b85-b53ed1e421bc tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:11.993059 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-50406b52-4ddf-4568-8b85-b53ed1e421bc tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:14:12.003092 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-50406b52-4ddf-4568-8b85-b53ed1e421bc tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9" status: 200 len: 1555 microversion: 2.1 time: 0.267846 Jul 25 23:14:12.003973 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 482/961] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:14:11 2022] GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 => generated 1555 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:14:12.029722 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-016af6ce-f0f0-4b23-b129-3fa71c8551c8 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:14:12.030825 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-016af6ce-f0f0-4b23-b129-3fa71c8551c8 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d442d7e2-afaf-4db1-8130-b13d2f5cc7e9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:14:12.038906 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-016af6ce-f0f0-4b23-b129-3fa71c8551c8 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:12.039451 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-016af6ce-f0f0-4b23-b129-3fa71c8551c8 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:12.040131 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-016af6ce-f0f0-4b23-b129-3fa71c8551c8 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:12.040766 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-016af6ce-f0f0-4b23-b129-3fa71c8551c8 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:12.150858 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-016af6ce-f0f0-4b23-b129-3fa71c8551c8 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.125173 Jul 25 23:14:12.151771 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 480/962] 10.222.0.55 () {58 vars in 1275 bytes} [Mon Jul 25 23:14:12 2022] GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9/os-interface => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:14:13.987452 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-dab3e1c4-83c8-4fcc-9695-0eda00e35ead req-6b5df356-59fd-4564-9ef0-be47b3a6e607 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d442d7e2-afaf-4db1-8130-b13d2f5cc7e9", "tag": "f3f3699e-fbf9-46b4-a96e-46959ebc31c3"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:14:13.996278 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-dab3e1c4-83c8-4fcc-9695-0eda00e35ead req-6b5df356-59fd-4564-9ef0-be47b3a6e607 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:13.996802 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-dab3e1c4-83c8-4fcc-9695-0eda00e35ead req-6b5df356-59fd-4564-9ef0-be47b3a6e607 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:14.010252 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-dab3e1c4-83c8-4fcc-9695-0eda00e35ead req-6b5df356-59fd-4564-9ef0-be47b3a6e607 service nova] Creating event network-changed:f3f3699e-fbf9-46b4-a96e-46959ebc31c3 for instance d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 on hv-cinder-79760 Jul 25 23:14:14.016080 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-dab3e1c4-83c8-4fcc-9695-0eda00e35ead req-6b5df356-59fd-4564-9ef0-be47b3a6e607 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034209 Jul 25 23:14:14.017526 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 483/963] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:14:21.472974 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-c2d06407-369f-49df-a040-2aa3f7c40e03 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Action: 'create', calling method: .version_select at 0x7f6226e79670>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1194749679", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN3jC4jP/V/40nvyDb5kx+bQvOT+JuzrK7kdzM7vgq5XC4OpQCaHGY2wHvIesrmriNnAURP37ZswrH5CS0R+i9KoDwjOklIkhOdkyBzoZj6RD1UBZ+bWaAgslNq7OHTDzA=="}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:14:21.490561 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-c2d06407-369f-49df-a040-2aa3f7c40e03 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Getting quotas for project f661a74731894c6e94eced8d8f7520e7. Resources: {'key_pairs'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 23:14:21.495013 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-c2d06407-369f-49df-a040-2aa3f7c40e03 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Getting quotas for user c862a035745641b5a8dde92a3d570b35 and project f661a74731894c6e94eced8d8f7520e7. Resources: {'key_pairs'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 23:14:21.618486 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-c2d06407-369f-49df-a040-2aa3f7c40e03 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.341634 Jul 25 23:14:21.618486 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 481/964] 10.222.0.55 () {60 vars in 1159 bytes} [Mon Jul 25 23:14:21 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:14:39.719078 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4f6bffb9-76e6-4e32-aeb0-e191d7f31e04 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-219116583", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1194749679", "security_groups": [{"name": "tempest-secgroup-smoke-488560059"}], "block_device_mapping_v2": [{"uuid": "c98c14d5-6e34-4fa3-b45b-545cb0d9d4d3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ccff6ef8-9de0-43b7-8ccb-43439046b3f0"}]}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:14:39.728763 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=5 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:14:39.729432 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=9 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:14:39.832579 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.network.neutron [None req-4f6bffb9-76e6-4e32-aeb0-e191d7f31e04 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] validate_networks() for [('ccff6ef8-9de0-43b7-8ccb-43439046b3f0', None, None, None, None, None)] {{(pid=118410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 23:14:40.205924 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-4f6bffb9-76e6-4e32-aeb0-e191d7f31e04 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Flavor limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 23:14:40.206342 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-4f6bffb9-76e6-4e32-aeb0-e191d7f31e04 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Image limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 23:14:40.206803 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-4f6bffb9-76e6-4e32-aeb0-e191d7f31e04 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Flavor pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 23:14:40.207200 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-4f6bffb9-76e6-4e32-aeb0-e191d7f31e04 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Image pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 23:14:40.207599 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-4f6bffb9-76e6-4e32-aeb0-e191d7f31e04 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 23:14:40.216976 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4f6bffb9-76e6-4e32-aeb0-e191d7f31e04 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:40.217436 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4f6bffb9-76e6-4e32-aeb0-e191d7f31e04 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:40.218224 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4f6bffb9-76e6-4e32-aeb0-e191d7f31e04 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:40.218651 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4f6bffb9-76e6-4e32-aeb0-e191d7f31e04 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:40.235586 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-4f6bffb9-76e6-4e32-aeb0-e191d7f31e04 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Getting quotas for project f661a74731894c6e94eced8d8f7520e7. Resources: {'instances', 'cores', 'ram'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 23:14:40.239497 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-4f6bffb9-76e6-4e32-aeb0-e191d7f31e04 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Getting quotas for user c862a035745641b5a8dde92a3d570b35 and project f661a74731894c6e94eced8d8f7520e7. Resources: {'instances', 'cores', 'ram'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 23:14:40.296399 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4f6bffb9-76e6-4e32-aeb0-e191d7f31e04 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Going to run 1 instances... {{(pid=118410) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 23:14:40.298673 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4f6bffb9-76e6-4e32-aeb0-e191d7f31e04 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: f900a476-26ad-48ba-95f9-eb96fa8b9dbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c98c14d5-6e34-4fa3-b45b-545cb0d9d4d3',volume_size=None,volume_type=None)] {{(pid=118410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 23:14:40.695190 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4f6bffb9-76e6-4e32-aeb0-e191d7f31e04 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.981109 Jul 25 23:14:40.695761 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 484/965] 10.222.0.55 () {60 vars in 1147 bytes} [Mon Jul 25 23:14:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 23:14:40.703635 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=15 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:14:40.704966 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell0:SELECT=4 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:14:40.705759 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_api:SELECT=16,nova_api:INSERT=1 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:14:40.709597 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-a723f216-e15d-4964-9547-b00afbf58609 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:14:40.710203 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-a723f216-e15d-4964-9547-b00afbf58609 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: f900a476-26ad-48ba-95f9-eb96fa8b9dbe] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:14:40.764518 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-a723f216-e15d-4964-9547-b00afbf58609 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:14:40.771987 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-a723f216-e15d-4964-9547-b00afbf58609 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe" status: 200 len: 1094 microversion: 2.1 time: 0.069148 Jul 25 23:14:40.780003 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 482/966] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:14:40 2022] GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:14:41.793872 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-70a9e856-3b42-482a-b477-0f4fd8c4fae9 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:14:41.794647 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-70a9e856-3b42-482a-b477-0f4fd8c4fae9 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: f900a476-26ad-48ba-95f9-eb96fa8b9dbe] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:14:41.801076 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-70a9e856-3b42-482a-b477-0f4fd8c4fae9 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:41.802458 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-70a9e856-3b42-482a-b477-0f4fd8c4fae9 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:41.802458 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-70a9e856-3b42-482a-b477-0f4fd8c4fae9 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:41.802813 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-70a9e856-3b42-482a-b477-0f4fd8c4fae9 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:41.865936 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-70a9e856-3b42-482a-b477-0f4fd8c4fae9 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:14:41.874177 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-70a9e856-3b42-482a-b477-0f4fd8c4fae9 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe" status: 200 len: 1144 microversion: 2.1 time: 0.084901 Jul 25 23:14:41.874966 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 485/967] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:14:41 2022] GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:14:42.895865 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-312ff3a3-2411-41d7-a22b-225fe272855a tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:14:42.896497 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-312ff3a3-2411-41d7-a22b-225fe272855a tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: f900a476-26ad-48ba-95f9-eb96fa8b9dbe] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:14:42.904607 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-312ff3a3-2411-41d7-a22b-225fe272855a tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:42.905145 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-312ff3a3-2411-41d7-a22b-225fe272855a tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:42.905928 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-312ff3a3-2411-41d7-a22b-225fe272855a tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:42.906360 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-312ff3a3-2411-41d7-a22b-225fe272855a tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:42.981066 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-312ff3a3-2411-41d7-a22b-225fe272855a tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:14:42.988640 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-312ff3a3-2411-41d7-a22b-225fe272855a tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe" status: 200 len: 1200 microversion: 2.1 time: 0.097248 Jul 25 23:14:42.989557 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 483/968] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:14:42 2022] GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe => generated 1200 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:14:44.014950 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b0cf06fd-4e11-457d-a2b1-0ea7d335b811 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:14:44.016657 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b0cf06fd-4e11-457d-a2b1-0ea7d335b811 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: f900a476-26ad-48ba-95f9-eb96fa8b9dbe] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:14:44.022288 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b0cf06fd-4e11-457d-a2b1-0ea7d335b811 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:44.022733 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b0cf06fd-4e11-457d-a2b1-0ea7d335b811 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:44.023505 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b0cf06fd-4e11-457d-a2b1-0ea7d335b811 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:44.023935 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b0cf06fd-4e11-457d-a2b1-0ea7d335b811 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:44.179433 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b0cf06fd-4e11-457d-a2b1-0ea7d335b811 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:14:44.189754 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b0cf06fd-4e11-457d-a2b1-0ea7d335b811 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe" status: 200 len: 1277 microversion: 2.1 time: 0.179268 Jul 25 23:14:44.190595 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 486/969] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:14:44 2022] GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe => generated 1277 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:14:45.059045 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-1dee1e8b-6367-40c1-aa8e-5e98f7b4394a req-881bde8c-3561-44c1-bed4-40ea59d43246 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f900a476-26ad-48ba-95f9-eb96fa8b9dbe", "tag": "15c82377-73db-4e12-a607-be4262be29e4"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:14:45.070488 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-1dee1e8b-6367-40c1-aa8e-5e98f7b4394a req-881bde8c-3561-44c1-bed4-40ea59d43246 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:45.070896 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-1dee1e8b-6367-40c1-aa8e-5e98f7b4394a req-881bde8c-3561-44c1-bed4-40ea59d43246 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:45.083329 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-1dee1e8b-6367-40c1-aa8e-5e98f7b4394a req-881bde8c-3561-44c1-bed4-40ea59d43246 service nova] Creating event network-changed:15c82377-73db-4e12-a607-be4262be29e4 for instance f900a476-26ad-48ba-95f9-eb96fa8b9dbe on hv-cinder-79760 Jul 25 23:14:45.088574 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-1dee1e8b-6367-40c1-aa8e-5e98f7b4394a req-881bde8c-3561-44c1-bed4-40ea59d43246 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033367 Jul 25 23:14:45.089224 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 484/970] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:14:45.215038 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-11e51067-cb01-42cf-b8f3-401a162aa7fd tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:14:45.215725 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-11e51067-cb01-42cf-b8f3-401a162aa7fd tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: f900a476-26ad-48ba-95f9-eb96fa8b9dbe] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:14:45.222834 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-11e51067-cb01-42cf-b8f3-401a162aa7fd tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:45.227131 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-11e51067-cb01-42cf-b8f3-401a162aa7fd tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:45.227131 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-11e51067-cb01-42cf-b8f3-401a162aa7fd tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:45.227131 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-11e51067-cb01-42cf-b8f3-401a162aa7fd tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:45.434414 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-11e51067-cb01-42cf-b8f3-401a162aa7fd tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:14:45.442346 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-11e51067-cb01-42cf-b8f3-401a162aa7fd tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe" status: 200 len: 1265 microversion: 2.1 time: 0.232119 Jul 25 23:14:45.442918 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 487/971] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:14:45 2022] GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:14:46.464023 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-d98aa9fb-d5ef-4a82-9fba-cc3cb2df7b80 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:14:46.464871 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-d98aa9fb-d5ef-4a82-9fba-cc3cb2df7b80 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: f900a476-26ad-48ba-95f9-eb96fa8b9dbe] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:14:46.471215 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d98aa9fb-d5ef-4a82-9fba-cc3cb2df7b80 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:46.476919 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d98aa9fb-d5ef-4a82-9fba-cc3cb2df7b80 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:46.476919 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d98aa9fb-d5ef-4a82-9fba-cc3cb2df7b80 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:46.476919 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d98aa9fb-d5ef-4a82-9fba-cc3cb2df7b80 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:46.608172 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-d98aa9fb-d5ef-4a82-9fba-cc3cb2df7b80 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:14:46.615920 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-d98aa9fb-d5ef-4a82-9fba-cc3cb2df7b80 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe" status: 200 len: 1265 microversion: 2.1 time: 0.156615 Jul 25 23:14:46.616473 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 485/972] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:14:46 2022] GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:14:47.637502 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a184b1a8-d121-45f2-8d2a-3e422bacc057 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:14:47.638664 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a184b1a8-d121-45f2-8d2a-3e422bacc057 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: f900a476-26ad-48ba-95f9-eb96fa8b9dbe] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:14:47.645669 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a184b1a8-d121-45f2-8d2a-3e422bacc057 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:47.646118 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a184b1a8-d121-45f2-8d2a-3e422bacc057 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:47.646880 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a184b1a8-d121-45f2-8d2a-3e422bacc057 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:47.647310 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a184b1a8-d121-45f2-8d2a-3e422bacc057 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:47.779388 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a184b1a8-d121-45f2-8d2a-3e422bacc057 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:14:47.786795 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a184b1a8-d121-45f2-8d2a-3e422bacc057 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe" status: 200 len: 1265 microversion: 2.1 time: 0.153193 Jul 25 23:14:47.787352 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 488/973] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:14:47 2022] GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:14:48.807658 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-ab270932-92c9-4ae7-8da5-26a92c64d645 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:14:48.808197 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-ab270932-92c9-4ae7-8da5-26a92c64d645 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: f900a476-26ad-48ba-95f9-eb96fa8b9dbe] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:14:48.815024 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ab270932-92c9-4ae7-8da5-26a92c64d645 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:48.815468 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ab270932-92c9-4ae7-8da5-26a92c64d645 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:48.816357 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ab270932-92c9-4ae7-8da5-26a92c64d645 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:48.816793 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ab270932-92c9-4ae7-8da5-26a92c64d645 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:48.945462 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-ab270932-92c9-4ae7-8da5-26a92c64d645 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:14:48.952921 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-ab270932-92c9-4ae7-8da5-26a92c64d645 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe" status: 200 len: 1265 microversion: 2.1 time: 0.149328 Jul 25 23:14:48.953510 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 486/974] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:14:48 2022] GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:14:49.974129 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b751ff27-caa0-405b-a7b2-ce7c7552bd0b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:14:49.974684 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b751ff27-caa0-405b-a7b2-ce7c7552bd0b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: f900a476-26ad-48ba-95f9-eb96fa8b9dbe] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:14:49.982030 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b751ff27-caa0-405b-a7b2-ce7c7552bd0b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:49.982486 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b751ff27-caa0-405b-a7b2-ce7c7552bd0b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:49.983242 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b751ff27-caa0-405b-a7b2-ce7c7552bd0b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:49.983671 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b751ff27-caa0-405b-a7b2-ce7c7552bd0b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:50.115761 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b751ff27-caa0-405b-a7b2-ce7c7552bd0b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:14:50.119683 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-6ccd5daf-e498-45fd-822d-feb7fbb5a879 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:14:50.120170 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-6ccd5daf-e498-45fd-822d-feb7fbb5a879 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d442d7e2-afaf-4db1-8130-b13d2f5cc7e9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:14:50.124673 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b751ff27-caa0-405b-a7b2-ce7c7552bd0b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe" status: 200 len: 1265 microversion: 2.1 time: 0.154458 Jul 25 23:14:50.125266 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 489/975] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:14:49 2022] GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:14:50.128071 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6ccd5daf-e498-45fd-822d-feb7fbb5a879 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:50.128515 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6ccd5daf-e498-45fd-822d-feb7fbb5a879 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:50.129312 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6ccd5daf-e498-45fd-822d-feb7fbb5a879 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:50.129740 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6ccd5daf-e498-45fd-822d-feb7fbb5a879 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:50.152477 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-6ccd5daf-e498-45fd-822d-feb7fbb5a879 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9/ips" status: 200 len: 149 microversion: 2.1 time: 0.036637 Jul 25 23:14:50.153034 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 487/976] 10.222.0.55 () {58 vars in 1248 bytes} [Mon Jul 25 23:14:50 2022] GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:14:51.146096 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-78d07d64-6bfa-4843-b91c-297d6be97de3 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:14:51.146752 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-78d07d64-6bfa-4843-b91c-297d6be97de3 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: f900a476-26ad-48ba-95f9-eb96fa8b9dbe] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:14:51.148636 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=2 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:14:51.149454 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=6 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:14:51.155045 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-78d07d64-6bfa-4843-b91c-297d6be97de3 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:51.155581 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-78d07d64-6bfa-4843-b91c-297d6be97de3 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:51.156352 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-78d07d64-6bfa-4843-b91c-297d6be97de3 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:51.156790 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-78d07d64-6bfa-4843-b91c-297d6be97de3 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:51.288102 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-78d07d64-6bfa-4843-b91c-297d6be97de3 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:14:51.295772 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-78d07d64-6bfa-4843-b91c-297d6be97de3 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe" status: 200 len: 1265 microversion: 2.1 time: 0.153384 Jul 25 23:14:51.296329 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 490/977] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:14:51 2022] GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:14:51.828830 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-60e5edea-94b1-460a-8219-89e46d06a31a tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0bc78d20-10ae-427e-9a9b-f9c0951fc6b2"}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:14:51.831216 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-60e5edea-94b1-460a-8219-89e46d06a31a tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d442d7e2-afaf-4db1-8130-b13d2f5cc7e9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:14:51.833267 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell0:SELECT=2 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:14:51.838632 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-60e5edea-94b1-460a-8219-89e46d06a31a tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:51.840603 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-60e5edea-94b1-460a-8219-89e46d06a31a tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:51.840603 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-60e5edea-94b1-460a-8219-89e46d06a31a tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:51.840603 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-60e5edea-94b1-460a-8219-89e46d06a31a tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:52.315863 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a42e0ca3-ac32-4767-a15b-0fa92c24635a tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:14:52.316459 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a42e0ca3-ac32-4767-a15b-0fa92c24635a tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: f900a476-26ad-48ba-95f9-eb96fa8b9dbe] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:14:52.323119 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a42e0ca3-ac32-4767-a15b-0fa92c24635a tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:52.323571 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a42e0ca3-ac32-4767-a15b-0fa92c24635a tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:52.324336 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a42e0ca3-ac32-4767-a15b-0fa92c24635a tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:52.324769 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a42e0ca3-ac32-4767-a15b-0fa92c24635a tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:52.468882 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-a42e0ca3-ac32-4767-a15b-0fa92c24635a tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:14:52.476636 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a42e0ca3-ac32-4767-a15b-0fa92c24635a tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe" status: 200 len: 1265 microversion: 2.1 time: 0.164604 Jul 25 23:14:52.477214 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 491/978] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:14:52 2022] GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:14:52.630161 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-60e5edea-94b1-460a-8219-89e46d06a31a tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "POST /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.805145 Jul 25 23:14:52.630767 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 488/979] 10.222.0.55 () {60 vars in 1323 bytes} [Mon Jul 25 23:14:51 2022] POST /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9/os-volume_attachments => generated 194 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:14:53.498073 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-04bfab4f-e7a4-4704-b2d3-dfbc15c2ae4f tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:14:53.499221 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-04bfab4f-e7a4-4704-b2d3-dfbc15c2ae4f tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: f900a476-26ad-48ba-95f9-eb96fa8b9dbe] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:14:53.505698 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-04bfab4f-e7a4-4704-b2d3-dfbc15c2ae4f tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:53.506140 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-04bfab4f-e7a4-4704-b2d3-dfbc15c2ae4f tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:53.506905 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-04bfab4f-e7a4-4704-b2d3-dfbc15c2ae4f tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:53.507423 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-04bfab4f-e7a4-4704-b2d3-dfbc15c2ae4f tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:53.645544 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-04bfab4f-e7a4-4704-b2d3-dfbc15c2ae4f tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:14:53.653092 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-04bfab4f-e7a4-4704-b2d3-dfbc15c2ae4f tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe" status: 200 len: 1265 microversion: 2.1 time: 0.159117 Jul 25 23:14:53.653841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 492/980] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:14:53 2022] GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:14:54.675193 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-58bdd600-9a23-49fc-a1fc-c50a257a8c61 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:14:54.675947 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-58bdd600-9a23-49fc-a1fc-c50a257a8c61 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: f900a476-26ad-48ba-95f9-eb96fa8b9dbe] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:14:54.682274 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-58bdd600-9a23-49fc-a1fc-c50a257a8c61 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:54.682717 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-58bdd600-9a23-49fc-a1fc-c50a257a8c61 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:54.683468 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-58bdd600-9a23-49fc-a1fc-c50a257a8c61 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:54.683900 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-58bdd600-9a23-49fc-a1fc-c50a257a8c61 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:54.816888 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-58bdd600-9a23-49fc-a1fc-c50a257a8c61 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:14:54.824335 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-58bdd600-9a23-49fc-a1fc-c50a257a8c61 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe" status: 200 len: 1265 microversion: 2.1 time: 0.154148 Jul 25 23:14:54.824889 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 489/981] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:14:54 2022] GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:14:55.689834 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-7f02a877-0309-41b9-b5b6-6c2f3f6920aa req-da693fd0-0402-4386-8eac-22f8d78225e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f900a476-26ad-48ba-95f9-eb96fa8b9dbe", "name": "network-vif-plugged", "status": "completed", "tag": "15c82377-73db-4e12-a607-be4262be29e4"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:14:55.699578 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-7f02a877-0309-41b9-b5b6-6c2f3f6920aa req-da693fd0-0402-4386-8eac-22f8d78225e5 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:55.700021 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-7f02a877-0309-41b9-b5b6-6c2f3f6920aa req-da693fd0-0402-4386-8eac-22f8d78225e5 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:55.712147 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-7f02a877-0309-41b9-b5b6-6c2f3f6920aa req-da693fd0-0402-4386-8eac-22f8d78225e5 service nova] Creating event network-vif-plugged:15c82377-73db-4e12-a607-be4262be29e4 for instance f900a476-26ad-48ba-95f9-eb96fa8b9dbe on hv-cinder-79760 Jul 25 23:14:55.717353 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-7f02a877-0309-41b9-b5b6-6c2f3f6920aa req-da693fd0-0402-4386-8eac-22f8d78225e5 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031758 Jul 25 23:14:55.718057 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 493/982] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:14:55.847466 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-dc10b1d7-2d0b-4a0a-8851-d302643bd92f tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:14:55.848784 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-dc10b1d7-2d0b-4a0a-8851-d302643bd92f tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: f900a476-26ad-48ba-95f9-eb96fa8b9dbe] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:14:55.855529 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-dc10b1d7-2d0b-4a0a-8851-d302643bd92f tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:55.856637 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-dc10b1d7-2d0b-4a0a-8851-d302643bd92f tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:55.858891 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-dc10b1d7-2d0b-4a0a-8851-d302643bd92f tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:55.859335 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-dc10b1d7-2d0b-4a0a-8851-d302643bd92f tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:56.002410 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-dc10b1d7-2d0b-4a0a-8851-d302643bd92f tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:14:56.010020 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-dc10b1d7-2d0b-4a0a-8851-d302643bd92f tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe" status: 200 len: 1265 microversion: 2.1 time: 0.168630 Jul 25 23:14:56.010583 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 490/983] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:14:55 2022] GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:14:57.033732 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-017dc26c-cc5b-489d-b24f-289404f77612 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:14:57.034429 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-017dc26c-cc5b-489d-b24f-289404f77612 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: f900a476-26ad-48ba-95f9-eb96fa8b9dbe] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:14:57.040804 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-017dc26c-cc5b-489d-b24f-289404f77612 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:57.041286 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-017dc26c-cc5b-489d-b24f-289404f77612 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:57.042131 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-017dc26c-cc5b-489d-b24f-289404f77612 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:57.042568 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-017dc26c-cc5b-489d-b24f-289404f77612 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:57.180283 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-017dc26c-cc5b-489d-b24f-289404f77612 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:14:57.188597 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-017dc26c-cc5b-489d-b24f-289404f77612 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe" status: 200 len: 1265 microversion: 2.1 time: 0.159754 Jul 25 23:14:57.189203 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 494/984] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:14:57 2022] GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:14:58.210019 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-567d8796-d8ee-400d-9677-fdd8f0f08225 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:14:58.210557 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-567d8796-d8ee-400d-9677-fdd8f0f08225 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: f900a476-26ad-48ba-95f9-eb96fa8b9dbe] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:14:58.217607 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-567d8796-d8ee-400d-9677-fdd8f0f08225 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:58.218055 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-567d8796-d8ee-400d-9677-fdd8f0f08225 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:58.218817 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-567d8796-d8ee-400d-9677-fdd8f0f08225 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:58.219250 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-567d8796-d8ee-400d-9677-fdd8f0f08225 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:58.351787 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-567d8796-d8ee-400d-9677-fdd8f0f08225 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:14:58.359637 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-567d8796-d8ee-400d-9677-fdd8f0f08225 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe" status: 200 len: 1452 microversion: 2.1 time: 0.153601 Jul 25 23:14:58.360195 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 491/985] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:14:58 2022] GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:14:58.379432 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-3231392a-7379-4a8c-a78c-adeae91496ea tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:14:58.380034 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-3231392a-7379-4a8c-a78c-adeae91496ea tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: f900a476-26ad-48ba-95f9-eb96fa8b9dbe] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:14:58.386510 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3231392a-7379-4a8c-a78c-adeae91496ea tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:58.386954 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3231392a-7379-4a8c-a78c-adeae91496ea tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:58.387716 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3231392a-7379-4a8c-a78c-adeae91496ea tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:14:58.388148 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3231392a-7379-4a8c-a78c-adeae91496ea tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:14:58.524119 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-3231392a-7379-4a8c-a78c-adeae91496ea tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:14:58.532377 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-3231392a-7379-4a8c-a78c-adeae91496ea tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe" status: 200 len: 1452 microversion: 2.1 time: 0.156711 Jul 25 23:14:58.532944 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 495/986] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:14:58 2022] GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:15:00.155795 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-4e73b760-c725-4175-a620-6a7ccf675925 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0bc78d20-10ae-427e-9a9b-f9c0951fc6b2"}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:15:00.158501 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-4e73b760-c725-4175-a620-6a7ccf675925 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d442d7e2-afaf-4db1-8130-b13d2f5cc7e9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:15:00.165354 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4e73b760-c725-4175-a620-6a7ccf675925 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:00.165768 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4e73b760-c725-4175-a620-6a7ccf675925 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:00.166627 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4e73b760-c725-4175-a620-6a7ccf675925 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:00.167065 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4e73b760-c725-4175-a620-6a7ccf675925 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:00.244140 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.wsgi [None req-4e73b760-c725-4175-a620-6a7ccf675925 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] HTTP exception thrown: Invalid volume: volume 0bc78d20-10ae-427e-9a9b-f9c0951fc6b2 is already attached to instances: d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 Jul 25 23:15:00.245939 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-4e73b760-c725-4175-a620-6a7ccf675925 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Request method failure captured: Jul 25 23:15:00.245939 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: request: POST /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9/os-volume_attachments HTTP/1.1 Jul 25 23:15:00.245939 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept: application/json Jul 25 23:15:00.245939 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept-Encoding: identity Jul 25 23:15:00.245939 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Connection: close Jul 25 23:15:00.245939 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Length: 74 Jul 25 23:15:00.245939 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Type: application/json Jul 25 23:15:00.245939 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Host: 10.222.0.55 Jul 25 23:15:00.245939 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Openstack-System-Scope: None Jul 25 23:15:00.245939 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: User-Agent: python-urllib3/1.26.10 Jul 25 23:15:00.245939 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Auth-Token: gAAAAABi3yMnWBF6N7ojia5nXsORomJKEubbLBv0vxCjlfVfsMo4Tn2EFSjvpY4M7xgoUAXGyz8xdNhwjA2Y6j5eYhzQSRo3SbffFPsEnm8ehR5gzh2aHTMOW72yy4L7WJZWPo5TX3ANcF5axUZPg2syZaiRay85nhAKbscEZHRDYy-zr1KSX8Y Jul 25 23:15:00.245939 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Id: None Jul 25 23:15:00.245939 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Name: None Jul 25 23:15:00.245939 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Identity-Status: Confirmed Jul 25 23:15:00.245939 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Is-Admin-Project: True Jul 25 23:15:00.245939 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Id: default Jul 25 23:15:00.245939 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Name: Default Jul 25 23:15:00.245939 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Id: bca196a6befb4fae9531dc96a1e58d5f Jul 25 23:15:00.245939 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Name: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:15:00.245939 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Role: reader,member Jul 25 23:15:00.245939 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Roles: reader,member Jul 25 23:15:00.248954 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_bca196a6befb4fae9531dc96a1e58d5f", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:15:00.248954 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:15:00.248954 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Id: bca196a6befb4fae9531dc96a1e58d5f Jul 25 23:15:00.248954 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:15:00.248954 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User: tempest-AttachVolumeNegativeTest-920481926-project Jul 25 23:15:00.248954 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Id: default Jul 25 23:15:00.248954 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Name: Default Jul 25 23:15:00.248954 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Id: f54ad4a554de414a80ed03d62c1eb3a5 Jul 25 23:15:00.248954 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Name: tempest-AttachVolumeNegativeTest-920481926-project Jul 25 23:15:00.248954 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Jul 25 23:15:00.248954 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: {"volumeAttachment": {"volumeId": "0bc78d20-10ae-427e-9a9b-f9c0951fc6b2"}} Jul 25 23:15:00.248954 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: method: > Jul 25 23:15:00.249780 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: exception: Invalid volume: volume 0bc78d20-10ae-427e-9a9b-f9c0951fc6b2 is already attached to instances: d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 Jul 25 23:15:00.249780 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: action_args: {'server_id': 'd442d7e2-afaf-4db1-8130-b13d2f5cc7e9', 'body': {'volumeAttachment': {'volumeId': '0bc78d20-10ae-427e-9a9b-f9c0951fc6b2'}}} Jul 25 23:15:00.249780 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:15:00.249780 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:15:00.249780 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 25 23:15:00.249780 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 25 23:15:00.249780 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 25 23:15:00.249780 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 25 23:15:00.249780 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 25 23:15:00.249780 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 25 23:15:00.249780 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 25 23:15:00.249780 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 25 23:15:00.249780 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 25 23:15:00.249780 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 25 23:15:00.249780 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0bc78d20-10ae-427e-9a9b-f9c0951fc6b2 is already attached to instances: d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 Jul 25 23:15:00.249780 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:15:00.249780 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:15:00.249780 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:15:00.249780 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:15:00.251464 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:15:00.251464 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:15:00.251464 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:15:00.251464 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:15:00.251464 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:15:00.251464 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:15:00.251464 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 23:15:00.251464 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 23:15:00.251464 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 23:15:00.251464 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 23:15:00.251464 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 25 23:15:00.251464 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 25 23:15:00.251464 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 25 23:15:00.251464 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 25 23:15:00.251464 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0bc78d20-10ae-427e-9a9b-f9c0951fc6b2 is already attached to instances: d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 Jul 25 23:15:00.251464 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:15:00.251464 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:15:00.251464 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:15:00.251464 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:15:00.251464 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:15:00.254044 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:15:00.254044 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:15:00.254044 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:15:00.254044 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0bc78d20-10ae-427e-9a9b-f9c0951fc6b2 is already attached to instances: d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 Jul 25 23:15:00.254044 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:15:00.254044 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-4e73b760-c725-4175-a620-6a7ccf675925 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Returning 400 to user: Invalid volume: volume 0bc78d20-10ae-427e-9a9b-f9c0951fc6b2 is already attached to instances: d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 {{(pid=118409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:15:00.254044 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-4e73b760-c725-4175-a620-6a7ccf675925 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "POST /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095829 Jul 25 23:15:00.254044 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 492/987] 10.222.0.55 () {60 vars in 1323 bytes} [Mon Jul 25 23:15:00 2022] POST /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 25 23:15:00.317137 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-aab9e773-a4db-4698-a2d3-1214d073bab2 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:15:00.317672 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-aab9e773-a4db-4698-a2d3-1214d073bab2 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d442d7e2-afaf-4db1-8130-b13d2f5cc7e9] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:15:00.324022 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-aab9e773-a4db-4698-a2d3-1214d073bab2 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:00.327192 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-aab9e773-a4db-4698-a2d3-1214d073bab2 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:00.327192 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-aab9e773-a4db-4698-a2d3-1214d073bab2 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:00.327192 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-aab9e773-a4db-4698-a2d3-1214d073bab2 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:00.410164 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.objects.instance [None req-aab9e773-a4db-4698-a2d3-1214d073bab2 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lazy-loading 'services' on Instance uuid d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 {{(pid=118410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 23:15:00.596669 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-d47a39f0-bcbc-4068-9fbe-6367b3e80852 req-233121ce-c237-4462-857b-0dfcf3cd20f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f900a476-26ad-48ba-95f9-eb96fa8b9dbe", "tag": "15c82377-73db-4e12-a607-be4262be29e4"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:15:00.606951 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-d47a39f0-bcbc-4068-9fbe-6367b3e80852 req-233121ce-c237-4462-857b-0dfcf3cd20f5 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:00.608009 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-d47a39f0-bcbc-4068-9fbe-6367b3e80852 req-233121ce-c237-4462-857b-0dfcf3cd20f5 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:00.613668 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-aab9e773-a4db-4698-a2d3-1214d073bab2 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "DELETE /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9/os-volume_attachments/0bc78d20-10ae-427e-9a9b-f9c0951fc6b2" status: 202 len: 0 microversion: 2.1 time: 0.300243 Jul 25 23:15:00.614286 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 496/988] 10.222.0.55 () {58 vars in 1416 bytes} [Mon Jul 25 23:15:00 2022] DELETE /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9/os-volume_attachments/0bc78d20-10ae-427e-9a9b-f9c0951fc6b2 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 23:15:00.618805 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-d47a39f0-bcbc-4068-9fbe-6367b3e80852 req-233121ce-c237-4462-857b-0dfcf3cd20f5 service nova] Creating event network-changed:15c82377-73db-4e12-a607-be4262be29e4 for instance f900a476-26ad-48ba-95f9-eb96fa8b9dbe on hv-cinder-79760 Jul 25 23:15:00.624499 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-d47a39f0-bcbc-4068-9fbe-6367b3e80852 req-233121ce-c237-4462-857b-0dfcf3cd20f5 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031535 Jul 25 23:15:00.624956 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6a0f8c28-330c-45c9-9f73-70ea22d4f21b tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:15:00.628055 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 493/989] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 23:15:00.629066 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6a0f8c28-330c-45c9-9f73-70ea22d4f21b tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d442d7e2-afaf-4db1-8130-b13d2f5cc7e9] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:15:00.635831 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6a0f8c28-330c-45c9-9f73-70ea22d4f21b tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:00.636344 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6a0f8c28-330c-45c9-9f73-70ea22d4f21b tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:00.637238 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6a0f8c28-330c-45c9-9f73-70ea22d4f21b tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:00.637753 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6a0f8c28-330c-45c9-9f73-70ea22d4f21b tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:00.669108 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6a0f8c28-330c-45c9-9f73-70ea22d4f21b tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050113 Jul 25 23:15:00.675923 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 497/990] 10.222.0.55 () {58 vars in 1302 bytes} [Mon Jul 25 23:15:00 2022] GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 23:15:01.683870 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-01f835a5-623c-4347-bf4a-a7662199a863 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:15:01.687144 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-01f835a5-623c-4347-bf4a-a7662199a863 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d442d7e2-afaf-4db1-8130-b13d2f5cc7e9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:15:01.693558 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-01f835a5-623c-4347-bf4a-a7662199a863 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:01.694111 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-01f835a5-623c-4347-bf4a-a7662199a863 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:01.694899 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-01f835a5-623c-4347-bf4a-a7662199a863 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:01.695342 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-01f835a5-623c-4347-bf4a-a7662199a863 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:01.730479 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-01f835a5-623c-4347-bf4a-a7662199a863 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051511 Jul 25 23:15:01.735420 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 494/991] 10.222.0.55 () {58 vars in 1302 bytes} [Mon Jul 25 23:15:01 2022] GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:15:02.743211 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-778e430e-aea9-4b4d-b615-21109b19b51e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:15:02.745312 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-778e430e-aea9-4b4d-b615-21109b19b51e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d442d7e2-afaf-4db1-8130-b13d2f5cc7e9] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:15:02.752049 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-778e430e-aea9-4b4d-b615-21109b19b51e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:02.752520 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-778e430e-aea9-4b4d-b615-21109b19b51e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:02.753305 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-778e430e-aea9-4b4d-b615-21109b19b51e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:02.753743 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-778e430e-aea9-4b4d-b615-21109b19b51e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:02.783084 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-778e430e-aea9-4b4d-b615-21109b19b51e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043867 Jul 25 23:15:02.783639 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 498/992] 10.222.0.55 () {58 vars in 1302 bytes} [Mon Jul 25 23:15:02 2022] GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 23:15:02.848733 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-42ad54b4-2c91-487c-ba78-d93b0e4c9156 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:15:02.849282 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-42ad54b4-2c91-487c-ba78-d93b0e4c9156 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d442d7e2-afaf-4db1-8130-b13d2f5cc7e9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:15:02.855961 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-42ad54b4-2c91-487c-ba78-d93b0e4c9156 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:02.856415 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-42ad54b4-2c91-487c-ba78-d93b0e4c9156 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:02.857240 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-42ad54b4-2c91-487c-ba78-d93b0e4c9156 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:02.857677 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-42ad54b4-2c91-487c-ba78-d93b0e4c9156 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:02.882799 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-42ad54b4-2c91-487c-ba78-d93b0e4c9156 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d442d7e2-afaf-4db1-8130-b13d2f5cc7e9] Going to try to terminate instance {{(pid=118409) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 23:15:03.218289 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-42ad54b4-2c91-487c-ba78-d93b0e4c9156 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "DELETE /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9" status: 204 len: 0 microversion: 2.1 time: 0.373163 Jul 25 23:15:03.218880 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 495/993] 10.222.0.55 () {58 vars in 1239 bytes} [Mon Jul 25 23:15:02 2022] DELETE /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 23:15:03.227049 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-9e15e0a1-265f-4bb8-a0d0-12aa21519bf6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:15:03.227662 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-9e15e0a1-265f-4bb8-a0d0-12aa21519bf6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d442d7e2-afaf-4db1-8130-b13d2f5cc7e9] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:15:03.233741 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9e15e0a1-265f-4bb8-a0d0-12aa21519bf6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:03.234192 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9e15e0a1-265f-4bb8-a0d0-12aa21519bf6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:03.234962 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9e15e0a1-265f-4bb8-a0d0-12aa21519bf6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:03.235398 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9e15e0a1-265f-4bb8-a0d0-12aa21519bf6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:03.373784 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9e15e0a1-265f-4bb8-a0d0-12aa21519bf6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:15:03.381482 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-9e15e0a1-265f-4bb8-a0d0-12aa21519bf6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9" status: 200 len: 1680 microversion: 2.1 time: 0.158233 Jul 25 23:15:03.382067 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 499/994] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:15:03 2022] GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:15:04.404811 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-237e007f-b46d-4938-88e4-dc4f1d32d801 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:15:04.405650 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-237e007f-b46d-4938-88e4-dc4f1d32d801 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d442d7e2-afaf-4db1-8130-b13d2f5cc7e9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:15:04.412219 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-237e007f-b46d-4938-88e4-dc4f1d32d801 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:04.412703 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-237e007f-b46d-4938-88e4-dc4f1d32d801 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:04.413524 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-237e007f-b46d-4938-88e4-dc4f1d32d801 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:04.413960 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-237e007f-b46d-4938-88e4-dc4f1d32d801 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:04.544961 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-237e007f-b46d-4938-88e4-dc4f1d32d801 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:15:04.552614 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-237e007f-b46d-4938-88e4-dc4f1d32d801 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9" status: 200 len: 1680 microversion: 2.1 time: 0.152732 Jul 25 23:15:04.553198 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 496/995] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:15:04 2022] GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:15:05.574338 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5e67ad35-1cbd-4c1f-ad3c-bf2612c3fd8e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:15:05.574936 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-5e67ad35-1cbd-4c1f-ad3c-bf2612c3fd8e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d442d7e2-afaf-4db1-8130-b13d2f5cc7e9] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:15:05.582117 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5e67ad35-1cbd-4c1f-ad3c-bf2612c3fd8e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:05.582560 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5e67ad35-1cbd-4c1f-ad3c-bf2612c3fd8e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:05.583322 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5e67ad35-1cbd-4c1f-ad3c-bf2612c3fd8e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:05.583758 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5e67ad35-1cbd-4c1f-ad3c-bf2612c3fd8e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:05.659043 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-5e67ad35-1cbd-4c1f-ad3c-bf2612c3fd8e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:15:05.666442 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-5e67ad35-1cbd-4c1f-ad3c-bf2612c3fd8e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9" status: 200 len: 1613 microversion: 2.1 time: 0.095997 Jul 25 23:15:05.667006 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 500/996] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:15:05 2022] GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 => generated 1613 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:15:05.845557 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-a2be0e44-1182-4ba1-98e8-f53c214d9bc0 req-b763a1e7-ea35-4e7b-aa1e-8e9bc172aa23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d442d7e2-afaf-4db1-8130-b13d2f5cc7e9", "name": "network-vif-deleted", "tag": "f3f3699e-fbf9-46b4-a96e-46959ebc31c3"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:15:05.851771 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-a2be0e44-1182-4ba1-98e8-f53c214d9bc0 req-b763a1e7-ea35-4e7b-aa1e-8e9bc172aa23 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:05.852209 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-a2be0e44-1182-4ba1-98e8-f53c214d9bc0 req-b763a1e7-ea35-4e7b-aa1e-8e9bc172aa23 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:05.863955 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-a2be0e44-1182-4ba1-98e8-f53c214d9bc0 req-b763a1e7-ea35-4e7b-aa1e-8e9bc172aa23 service nova] Creating event network-vif-deleted:f3f3699e-fbf9-46b4-a96e-46959ebc31c3 for instance d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 on hv-cinder-79760 Jul 25 23:15:05.869182 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-a2be0e44-1182-4ba1-98e8-f53c214d9bc0 req-b763a1e7-ea35-4e7b-aa1e-8e9bc172aa23 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031735 Jul 25 23:15:05.869723 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 497/997] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:15:06.688824 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f303143f-6dc6-4c40-b75e-c1e4cc92b516 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:15:06.689998 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f303143f-6dc6-4c40-b75e-c1e4cc92b516 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d442d7e2-afaf-4db1-8130-b13d2f5cc7e9] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:15:06.696790 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f303143f-6dc6-4c40-b75e-c1e4cc92b516 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:06.697402 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f303143f-6dc6-4c40-b75e-c1e4cc92b516 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:06.698591 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f303143f-6dc6-4c40-b75e-c1e4cc92b516 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:06.699024 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f303143f-6dc6-4c40-b75e-c1e4cc92b516 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:06.703986 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:15:06.735458 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f303143f-6dc6-4c40-b75e-c1e4cc92b516 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:06.735899 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f303143f-6dc6-4c40-b75e-c1e4cc92b516 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:06.736343 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.objects.instance [None req-f303143f-6dc6-4c40-b75e-c1e4cc92b516 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lazy-loading 'fault' on Instance uuid d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 {{(pid=118410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 23:15:06.781194 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f303143f-6dc6-4c40-b75e-c1e4cc92b516 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:15:06.788779 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f303143f-6dc6-4c40-b75e-c1e4cc92b516 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9" status: 200 len: 1331 microversion: 2.1 time: 0.104822 Jul 25 23:15:06.789498 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 501/998] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:15:06 2022] GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:15:07.810774 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-59589bc5-04a7-4216-9caa-ce0e40a9a53d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:15:07.811396 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-59589bc5-04a7-4216-9caa-ce0e40a9a53d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d442d7e2-afaf-4db1-8130-b13d2f5cc7e9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:15:07.817761 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-59589bc5-04a7-4216-9caa-ce0e40a9a53d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:07.818196 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-59589bc5-04a7-4216-9caa-ce0e40a9a53d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:07.818948 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-59589bc5-04a7-4216-9caa-ce0e40a9a53d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:07.819376 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-59589bc5-04a7-4216-9caa-ce0e40a9a53d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:07.833179 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.wsgi [None req-59589bc5-04a7-4216-9caa-ce0e40a9a53d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] HTTP exception thrown: Instance d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 could not be found. Jul 25 23:15:07.834773 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-59589bc5-04a7-4216-9caa-ce0e40a9a53d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Request method failure captured: Jul 25 23:15:07.834773 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: request: GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 HTTP/1.1 Jul 25 23:15:07.834773 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept: application/json Jul 25 23:15:07.834773 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept-Encoding: identity Jul 25 23:15:07.834773 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Connection: close Jul 25 23:15:07.834773 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Length: 0 Jul 25 23:15:07.834773 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Type: application/json Jul 25 23:15:07.834773 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Host: 10.222.0.55 Jul 25 23:15:07.834773 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Openstack-System-Scope: None Jul 25 23:15:07.834773 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: User-Agent: python-urllib3/1.26.10 Jul 25 23:15:07.834773 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Auth-Token: gAAAAABi3yMnWBF6N7ojia5nXsORomJKEubbLBv0vxCjlfVfsMo4Tn2EFSjvpY4M7xgoUAXGyz8xdNhwjA2Y6j5eYhzQSRo3SbffFPsEnm8ehR5gzh2aHTMOW72yy4L7WJZWPo5TX3ANcF5axUZPg2syZaiRay85nhAKbscEZHRDYy-zr1KSX8Y Jul 25 23:15:07.834773 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Id: None Jul 25 23:15:07.834773 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Name: None Jul 25 23:15:07.834773 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Identity-Status: Confirmed Jul 25 23:15:07.834773 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Is-Admin-Project: True Jul 25 23:15:07.834773 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Id: default Jul 25 23:15:07.834773 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Name: Default Jul 25 23:15:07.834773 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Id: bca196a6befb4fae9531dc96a1e58d5f Jul 25 23:15:07.834773 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Name: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:15:07.834773 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Role: reader,member Jul 25 23:15:07.834773 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Roles: reader,member Jul 25 23:15:07.836340 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_bca196a6befb4fae9531dc96a1e58d5f", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:15:07.836340 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:15:07.836340 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Id: bca196a6befb4fae9531dc96a1e58d5f Jul 25 23:15:07.836340 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:15:07.836340 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User: tempest-AttachVolumeNegativeTest-920481926-project Jul 25 23:15:07.836340 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Id: default Jul 25 23:15:07.836340 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Name: Default Jul 25 23:15:07.836340 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Id: f54ad4a554de414a80ed03d62c1eb3a5 Jul 25 23:15:07.836340 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Name: tempest-AttachVolumeNegativeTest-920481926-project Jul 25 23:15:07.836340 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: method: > Jul 25 23:15:07.836340 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: exception: Instance d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 could not be found. Jul 25 23:15:07.836340 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: action_args: {'id': 'd442d7e2-afaf-4db1-8130-b13d2f5cc7e9'} Jul 25 23:15:07.837204 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:15:07.837204 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:15:07.837204 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:15:07.837204 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:15:07.837204 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:15:07.837204 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:15:07.837204 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:15:07.837204 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:15:07.837204 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:15:07.837204 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:15:07.837204 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 could not be found. Jul 25 23:15:07.837204 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:15:07.837204 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:15:07.837204 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:15:07.837204 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:15:07.837204 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:15:07.837204 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:15:07.837204 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:15:07.837204 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:15:07.837204 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:15:07.838689 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:15:07.838689 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 23:15:07.838689 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 23:15:07.838689 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:15:07.838689 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:15:07.838689 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:15:07.838689 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:15:07.838689 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 could not be found. Jul 25 23:15:07.838689 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:15:07.838689 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:15:07.838689 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:15:07.838689 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:15:07.838689 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:15:07.838689 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:15:07.838689 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:15:07.838689 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:15:07.838689 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 could not be found. Jul 25 23:15:07.838689 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:15:07.840116 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-59589bc5-04a7-4216-9caa-ce0e40a9a53d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Returning 404 to user: Instance d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 could not be found. {{(pid=118409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:15:07.840116 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-59589bc5-04a7-4216-9caa-ce0e40a9a53d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9" status: 404 len: 111 microversion: 2.1 time: 0.030216 Jul 25 23:15:07.840116 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 498/999] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:15:07 2022] GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:15:07.846198 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-3b34f9f2-3b23-43ba-942c-92efdc65bcb1 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '.version_select at 0x7f6226ef68b0>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:15:07.918699 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-3b34f9f2-3b23-43ba-942c-92efdc65bcb1 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-268320819" status: 202 len: 0 microversion: 2.1 time: 0.077110 Jul 25 23:15:07.919273 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 502/1000] 10.222.0.55 () {58 vars in 1218 bytes} [Mon Jul 25 23:15:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-268320819 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 23:15:08.629051 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-5a81ecbe-1cd2-4d7c-9537-78e5f03d88ec tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Action: 'create', calling method: .version_select at 0x7f6226fa6040>, body: {"keypair": {"name": "tempest-keypair-136581029", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUfU5ILW3FbZoFhkD2iKUZmiO5jBz48kj1vXbIRxxcufjJTviEGltcRusvQtY2zQvpzWH1OHRvkmV3bUyewJH1oMYK8dNYfQ/TW3G/Cret3OPyRrQ6IjhqkiQj6sExMKw=="}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:15:08.645051 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-5a81ecbe-1cd2-4d7c-9537-78e5f03d88ec tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Getting quotas for project bca196a6befb4fae9531dc96a1e58d5f. Resources: {'key_pairs'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 23:15:08.648829 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-5a81ecbe-1cd2-4d7c-9537-78e5f03d88ec tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Getting quotas for user f54ad4a554de414a80ed03d62c1eb3a5 and project bca196a6befb4fae9531dc96a1e58d5f. Resources: {'key_pairs'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 23:15:08.724770 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-5a81ecbe-1cd2-4d7c-9537-78e5f03d88ec tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.099689 Jul 25 23:15:08.725338 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 499/1001] 10.222.0.55 () {60 vars in 1159 bytes} [Mon Jul 25 23:15:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:15:10.924609 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0edf825b-9cd4-4509-a40e-5c8181eff354 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2120694717", "imageRef": "8e9f3265-0fdf-483a-8e2e-41d408f5f0e7", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "61b90c6f-f28d-4718-a9dc-fcf196e75d09"}], "security_groups": [{"name": "tempest-securitygroup--1931316613"}], "key_name": "tempest-keypair-136581029", "user_data": "}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:15:10.932234 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:15:11.025495 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.network.neutron [None req-0edf825b-9cd4-4509-a40e-5c8181eff354 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] validate_networks() for [('61b90c6f-f28d-4718-a9dc-fcf196e75d09', None, None, None, None, None)] {{(pid=118410) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 23:15:11.382542 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-0edf825b-9cd4-4509-a40e-5c8181eff354 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Flavor limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 23:15:11.382982 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-0edf825b-9cd4-4509-a40e-5c8181eff354 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Image limits 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 23:15:11.383430 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-0edf825b-9cd4-4509-a40e-5c8181eff354 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Flavor pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 23:15:11.383835 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-0edf825b-9cd4-4509-a40e-5c8181eff354 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Image pref 0:0:0 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 23:15:11.384244 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.virt.hardware [None req-0edf825b-9cd4-4509-a40e-5c8181eff354 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118410) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 23:15:11.393473 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0edf825b-9cd4-4509-a40e-5c8181eff354 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:11.393919 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0edf825b-9cd4-4509-a40e-5c8181eff354 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:11.394726 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0edf825b-9cd4-4509-a40e-5c8181eff354 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:11.395157 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0edf825b-9cd4-4509-a40e-5c8181eff354 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:11.412651 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-0edf825b-9cd4-4509-a40e-5c8181eff354 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Getting quotas for project bca196a6befb4fae9531dc96a1e58d5f. Resources: {'instances', 'cores', 'ram'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 23:15:11.416585 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-0edf825b-9cd4-4509-a40e-5c8181eff354 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Getting quotas for user f54ad4a554de414a80ed03d62c1eb3a5 and project bca196a6befb4fae9531dc96a1e58d5f. Resources: {'instances', 'cores', 'ram'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 23:15:11.428206 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-0edf825b-9cd4-4509-a40e-5c8181eff354 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Going to run 1 instances... {{(pid=118410) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 23:15:11.430485 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-0edf825b-9cd4-4509-a40e-5c8181eff354 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 287e8432-d3b2-40f6-8ade-2269cb44ce5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e9f3265-0fdf-483a-8e2e-41d408f5f0e7',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118410) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 23:15:11.580981 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-0edf825b-9cd4-4509-a40e-5c8181eff354 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.661736 Jul 25 23:15:11.581553 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 503/1002] 10.222.0.55 () {60 vars in 1147 bytes} [Mon Jul 25 23:15:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 23:15:11.592745 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-3e250826-3300-4a05-8f23-9e5396f44df8 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:15:11.594046 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-3e250826-3300-4a05-8f23-9e5396f44df8 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 287e8432-d3b2-40f6-8ade-2269cb44ce5b] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:15:11.656877 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-3e250826-3300-4a05-8f23-9e5396f44df8 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:15:11.661832 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-3e250826-3300-4a05-8f23-9e5396f44df8 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b" status: 200 len: 1241 microversion: 2.1 time: 0.073402 Jul 25 23:15:11.662398 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 500/1003] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:15:11 2022] GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b => generated 1241 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:15:12.683518 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-016d424b-ac61-4d7f-9591-3bd66119fd36 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:15:12.684096 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-016d424b-ac61-4d7f-9591-3bd66119fd36 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 287e8432-d3b2-40f6-8ade-2269cb44ce5b] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:15:12.690990 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-016d424b-ac61-4d7f-9591-3bd66119fd36 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:12.691434 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-016d424b-ac61-4d7f-9591-3bd66119fd36 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:12.692251 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-016d424b-ac61-4d7f-9591-3bd66119fd36 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:12.692702 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-016d424b-ac61-4d7f-9591-3bd66119fd36 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:12.753739 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-016d424b-ac61-4d7f-9591-3bd66119fd36 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:15:12.761033 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-016d424b-ac61-4d7f-9591-3bd66119fd36 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b" status: 200 len: 1245 microversion: 2.1 time: 0.082064 Jul 25 23:15:12.761632 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 504/1004] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:15:12 2022] GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b => generated 1245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:15:13.781885 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-1e8cbb5a-0776-4f27-b36e-440f07bafb5d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:15:13.783039 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-1e8cbb5a-0776-4f27-b36e-440f07bafb5d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 287e8432-d3b2-40f6-8ade-2269cb44ce5b] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:15:13.786628 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:15:13.790150 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1e8cbb5a-0776-4f27-b36e-440f07bafb5d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:13.790587 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1e8cbb5a-0776-4f27-b36e-440f07bafb5d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:13.791343 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1e8cbb5a-0776-4f27-b36e-440f07bafb5d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:13.791769 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1e8cbb5a-0776-4f27-b36e-440f07bafb5d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:13.794358 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:15:13.869264 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-1e8cbb5a-0776-4f27-b36e-440f07bafb5d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:15:13.877593 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-1e8cbb5a-0776-4f27-b36e-440f07bafb5d tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b" status: 200 len: 1301 microversion: 2.1 time: 0.099798 Jul 25 23:15:13.878160 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 501/1005] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:15:13 2022] GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b => generated 1301 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:15:14.901035 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5af4d3c3-82cf-4e67-92f8-934179451012 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:15:14.901665 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-5af4d3c3-82cf-4e67-92f8-934179451012 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 287e8432-d3b2-40f6-8ade-2269cb44ce5b] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:15:14.908277 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5af4d3c3-82cf-4e67-92f8-934179451012 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:14.908724 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5af4d3c3-82cf-4e67-92f8-934179451012 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:14.909523 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5af4d3c3-82cf-4e67-92f8-934179451012 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:14.909954 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5af4d3c3-82cf-4e67-92f8-934179451012 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:15.107745 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-5af4d3c3-82cf-4e67-92f8-934179451012 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:15:15.122969 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-5af4d3c3-82cf-4e67-92f8-934179451012 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b" status: 200 len: 1367 microversion: 2.1 time: 0.218531 Jul 25 23:15:15.122969 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 505/1006] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:15:14 2022] GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:15:15.528336 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-a0624d02-a125-42e0-8148-6e62378ed69d req-45073ab6-c6c2-4bc2-82a6-0387b59cee1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "287e8432-d3b2-40f6-8ade-2269cb44ce5b", "tag": "0ac21e88-e7df-4fa4-93d4-dd0428cdb04f"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:15:15.546061 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-a0624d02-a125-42e0-8148-6e62378ed69d req-45073ab6-c6c2-4bc2-82a6-0387b59cee1e service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:15.546061 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-a0624d02-a125-42e0-8148-6e62378ed69d req-45073ab6-c6c2-4bc2-82a6-0387b59cee1e service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:15.556508 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-a0624d02-a125-42e0-8148-6e62378ed69d req-45073ab6-c6c2-4bc2-82a6-0387b59cee1e service nova] Creating event network-changed:0ac21e88-e7df-4fa4-93d4-dd0428cdb04f for instance 287e8432-d3b2-40f6-8ade-2269cb44ce5b on hv-cinder-79760 Jul 25 23:15:15.561403 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-a0624d02-a125-42e0-8148-6e62378ed69d req-45073ab6-c6c2-4bc2-82a6-0387b59cee1e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037734 Jul 25 23:15:15.562176 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 502/1007] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:15:16.137081 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-876aad5a-ee8a-4265-8b1a-ddbb95721b87 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:15:16.137711 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-876aad5a-ee8a-4265-8b1a-ddbb95721b87 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 287e8432-d3b2-40f6-8ade-2269cb44ce5b] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:15:16.145197 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-876aad5a-ee8a-4265-8b1a-ddbb95721b87 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:16.145640 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-876aad5a-ee8a-4265-8b1a-ddbb95721b87 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:16.146404 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-876aad5a-ee8a-4265-8b1a-ddbb95721b87 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:16.146833 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-876aad5a-ee8a-4265-8b1a-ddbb95721b87 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:16.356163 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-876aad5a-ee8a-4265-8b1a-ddbb95721b87 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:15:16.363675 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-876aad5a-ee8a-4265-8b1a-ddbb95721b87 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b" status: 200 len: 1367 microversion: 2.1 time: 0.230393 Jul 25 23:15:16.364247 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 506/1008] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:15:16 2022] GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:15:17.385792 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-7bb12dea-c7c4-438b-ba21-43678ed71dd1 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:15:17.386486 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-7bb12dea-c7c4-438b-ba21-43678ed71dd1 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 287e8432-d3b2-40f6-8ade-2269cb44ce5b] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:15:17.394972 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7bb12dea-c7c4-438b-ba21-43678ed71dd1 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:17.395415 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7bb12dea-c7c4-438b-ba21-43678ed71dd1 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:17.396176 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7bb12dea-c7c4-438b-ba21-43678ed71dd1 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:17.396609 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7bb12dea-c7c4-438b-ba21-43678ed71dd1 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:17.529633 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-7bb12dea-c7c4-438b-ba21-43678ed71dd1 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:15:17.537421 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-7bb12dea-c7c4-438b-ba21-43678ed71dd1 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b" status: 200 len: 1367 microversion: 2.1 time: 0.155857 Jul 25 23:15:17.537976 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 503/1009] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:15:17 2022] GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:15:18.559077 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e974ce2e-604f-46d3-a940-ffa40ff6f411 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:15:18.559673 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e974ce2e-604f-46d3-a940-ffa40ff6f411 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 287e8432-d3b2-40f6-8ade-2269cb44ce5b] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:15:18.566379 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e974ce2e-604f-46d3-a940-ffa40ff6f411 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:18.566821 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e974ce2e-604f-46d3-a940-ffa40ff6f411 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:18.567595 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e974ce2e-604f-46d3-a940-ffa40ff6f411 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:18.568012 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e974ce2e-604f-46d3-a940-ffa40ff6f411 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:18.700574 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e974ce2e-604f-46d3-a940-ffa40ff6f411 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:15:18.709173 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e974ce2e-604f-46d3-a940-ffa40ff6f411 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b" status: 200 len: 1367 microversion: 2.1 time: 0.153812 Jul 25 23:15:18.709775 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 507/1010] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:15:18 2022] GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:15:19.730364 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-1e75a3f9-7a3d-4e49-a636-9bcfa3941694 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:15:19.730965 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-1e75a3f9-7a3d-4e49-a636-9bcfa3941694 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 287e8432-d3b2-40f6-8ade-2269cb44ce5b] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:15:19.738365 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1e75a3f9-7a3d-4e49-a636-9bcfa3941694 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:19.738748 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1e75a3f9-7a3d-4e49-a636-9bcfa3941694 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:19.739506 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1e75a3f9-7a3d-4e49-a636-9bcfa3941694 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:19.739933 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1e75a3f9-7a3d-4e49-a636-9bcfa3941694 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:19.871955 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-1e75a3f9-7a3d-4e49-a636-9bcfa3941694 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:15:19.879516 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-1e75a3f9-7a3d-4e49-a636-9bcfa3941694 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b" status: 200 len: 1367 microversion: 2.1 time: 0.153108 Jul 25 23:15:19.880073 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 504/1011] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:15:19 2022] GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:15:20.900905 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-1bde8a7f-56da-44c0-9b25-d5ce750c2b84 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:15:20.901531 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-1bde8a7f-56da-44c0-9b25-d5ce750c2b84 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 287e8432-d3b2-40f6-8ade-2269cb44ce5b] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:15:20.908539 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1bde8a7f-56da-44c0-9b25-d5ce750c2b84 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:20.908976 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1bde8a7f-56da-44c0-9b25-d5ce750c2b84 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:20.909769 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1bde8a7f-56da-44c0-9b25-d5ce750c2b84 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:20.910198 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1bde8a7f-56da-44c0-9b25-d5ce750c2b84 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:21.037795 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-1bde8a7f-56da-44c0-9b25-d5ce750c2b84 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:15:21.045347 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-1bde8a7f-56da-44c0-9b25-d5ce750c2b84 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b" status: 200 len: 1367 microversion: 2.1 time: 0.148230 Jul 25 23:15:21.045906 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 508/1012] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:15:20 2022] GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:15:21.710269 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell0:SELECT=6 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:15:21.763056 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-e683dee7-7718-4ca0-b802-e6d619e432fc req-1a06cf7b-427f-4bc4-970f-9975b2b900bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "287e8432-d3b2-40f6-8ade-2269cb44ce5b", "name": "network-vif-plugged", "status": "completed", "tag": "0ac21e88-e7df-4fa4-93d4-dd0428cdb04f"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:15:21.773350 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-e683dee7-7718-4ca0-b802-e6d619e432fc req-1a06cf7b-427f-4bc4-970f-9975b2b900bf service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:21.773793 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-e683dee7-7718-4ca0-b802-e6d619e432fc req-1a06cf7b-427f-4bc4-970f-9975b2b900bf service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:21.784864 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-e683dee7-7718-4ca0-b802-e6d619e432fc req-1a06cf7b-427f-4bc4-970f-9975b2b900bf service nova] Creating event network-vif-plugged:0ac21e88-e7df-4fa4-93d4-dd0428cdb04f for instance 287e8432-d3b2-40f6-8ade-2269cb44ce5b on hv-cinder-79760 Jul 25 23:15:21.789651 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-e683dee7-7718-4ca0-b802-e6d619e432fc req-1a06cf7b-427f-4bc4-970f-9975b2b900bf service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084915 Jul 25 23:15:21.790227 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 505/1013] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:15:22.067735 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-3ed9a2d6-113b-4f87-875f-841eaeda04c0 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:15:22.068285 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-3ed9a2d6-113b-4f87-875f-841eaeda04c0 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 287e8432-d3b2-40f6-8ade-2269cb44ce5b] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:15:22.070152 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=2 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:15:22.070841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=6 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:15:22.076156 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3ed9a2d6-113b-4f87-875f-841eaeda04c0 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:22.076605 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3ed9a2d6-113b-4f87-875f-841eaeda04c0 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:22.077409 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3ed9a2d6-113b-4f87-875f-841eaeda04c0 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:22.077850 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3ed9a2d6-113b-4f87-875f-841eaeda04c0 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:22.275257 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-3ed9a2d6-113b-4f87-875f-841eaeda04c0 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:15:22.283925 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-3ed9a2d6-113b-4f87-875f-841eaeda04c0 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b" status: 200 len: 1367 microversion: 2.1 time: 0.221306 Jul 25 23:15:22.284455 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 509/1014] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:15:22 2022] GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:15:23.306015 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-55e71f8e-9661-40ac-a1b4-f7566503b179 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:15:23.306706 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-55e71f8e-9661-40ac-a1b4-f7566503b179 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 287e8432-d3b2-40f6-8ade-2269cb44ce5b] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:15:23.312990 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-55e71f8e-9661-40ac-a1b4-f7566503b179 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:23.313946 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-55e71f8e-9661-40ac-a1b4-f7566503b179 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:23.314713 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-55e71f8e-9661-40ac-a1b4-f7566503b179 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:23.315145 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-55e71f8e-9661-40ac-a1b4-f7566503b179 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:23.449577 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-55e71f8e-9661-40ac-a1b4-f7566503b179 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:15:23.457901 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-55e71f8e-9661-40ac-a1b4-f7566503b179 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b" status: 200 len: 1367 microversion: 2.1 time: 0.156890 Jul 25 23:15:23.458580 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 506/1015] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:15:23 2022] GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:15:24.478509 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-04bbaae3-ee5f-414d-9f83-4c5adc2a4758 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:15:24.479130 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-04bbaae3-ee5f-414d-9f83-4c5adc2a4758 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 287e8432-d3b2-40f6-8ade-2269cb44ce5b] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:15:24.486033 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-04bbaae3-ee5f-414d-9f83-4c5adc2a4758 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:24.486588 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-04bbaae3-ee5f-414d-9f83-4c5adc2a4758 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:24.487356 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-04bbaae3-ee5f-414d-9f83-4c5adc2a4758 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:24.487790 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-04bbaae3-ee5f-414d-9f83-4c5adc2a4758 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:24.616619 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-04bbaae3-ee5f-414d-9f83-4c5adc2a4758 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:15:24.624055 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-04bbaae3-ee5f-414d-9f83-4c5adc2a4758 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b" status: 200 len: 1556 microversion: 2.1 time: 0.149478 Jul 25 23:15:24.624626 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 510/1016] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:15:24 2022] GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b => generated 1556 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:15:24.645346 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-335f41f1-e612-4b7c-ae6c-95c46f8d8cfe tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:15:24.645876 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-335f41f1-e612-4b7c-ae6c-95c46f8d8cfe tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 287e8432-d3b2-40f6-8ade-2269cb44ce5b] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:15:24.652417 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-335f41f1-e612-4b7c-ae6c-95c46f8d8cfe tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:24.652863 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-335f41f1-e612-4b7c-ae6c-95c46f8d8cfe tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:24.653660 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-335f41f1-e612-4b7c-ae6c-95c46f8d8cfe tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:24.654095 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-335f41f1-e612-4b7c-ae6c-95c46f8d8cfe tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:24.730407 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-335f41f1-e612-4b7c-ae6c-95c46f8d8cfe tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089031 Jul 25 23:15:24.731017 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 507/1017] 10.222.0.55 () {58 vars in 1275 bytes} [Mon Jul 25 23:15:24 2022] GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:15:25.692239 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-2b0b1cd0-7ed4-406e-9662-9bd840bed801 req-4de98f82-3368-4a8e-b541-6627371da0b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "287e8432-d3b2-40f6-8ade-2269cb44ce5b", "tag": "0ac21e88-e7df-4fa4-93d4-dd0428cdb04f"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:15:25.702254 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-2b0b1cd0-7ed4-406e-9662-9bd840bed801 req-4de98f82-3368-4a8e-b541-6627371da0b6 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:25.702697 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-2b0b1cd0-7ed4-406e-9662-9bd840bed801 req-4de98f82-3368-4a8e-b541-6627371da0b6 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:25.714760 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-2b0b1cd0-7ed4-406e-9662-9bd840bed801 req-4de98f82-3368-4a8e-b541-6627371da0b6 service nova] Creating event network-changed:0ac21e88-e7df-4fa4-93d4-dd0428cdb04f for instance 287e8432-d3b2-40f6-8ade-2269cb44ce5b on hv-cinder-79760 Jul 25 23:15:25.720486 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-2b0b1cd0-7ed4-406e-9662-9bd840bed801 req-4de98f82-3368-4a8e-b541-6627371da0b6 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032256 Jul 25 23:15:25.721087 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 511/1018] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:15:57.037405 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_api:SELECT=13 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:15:57.038134 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=31 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:15:57.042814 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-74fd94f9-1175-4638-a16f-df0e03bdfbeb tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:15:57.045099 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-74fd94f9-1175-4638-a16f-df0e03bdfbeb tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 287e8432-d3b2-40f6-8ade-2269cb44ce5b] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:15:57.049140 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-74fd94f9-1175-4638-a16f-df0e03bdfbeb tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:57.049590 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-74fd94f9-1175-4638-a16f-df0e03bdfbeb tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:57.050343 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-74fd94f9-1175-4638-a16f-df0e03bdfbeb tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:57.050767 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-74fd94f9-1175-4638-a16f-df0e03bdfbeb tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:57.076610 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-74fd94f9-1175-4638-a16f-df0e03bdfbeb tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b/ips" status: 200 len: 148 microversion: 2.1 time: 0.040811 Jul 25 23:15:57.077200 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 508/1019] 10.222.0.55 () {58 vars in 1248 bytes} [Mon Jul 25 23:15:57 2022] GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 23:15:58.692528 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:15:58.693229 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=52 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:15:58.697527 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-1f85f48e-3457-409c-b885-d75a74fcadb6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff6c35ab-1ea1-493b-83c0-2f6a366cdfca"}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:15:58.700026 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-1f85f48e-3457-409c-b885-d75a74fcadb6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 287e8432-d3b2-40f6-8ade-2269cb44ce5b] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:15:58.706352 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1f85f48e-3457-409c-b885-d75a74fcadb6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:58.706799 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1f85f48e-3457-409c-b885-d75a74fcadb6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:58.707569 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1f85f48e-3457-409c-b885-d75a74fcadb6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:15:58.708004 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1f85f48e-3457-409c-b885-d75a74fcadb6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:15:59.426816 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-1f85f48e-3457-409c-b885-d75a74fcadb6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "POST /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.735762 Jul 25 23:15:59.427485 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 512/1020] 10.222.0.55 () {60 vars in 1323 bytes} [Mon Jul 25 23:15:58 2022] POST /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b/os-volume_attachments => generated 194 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:16:07.053266 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-b029891c-e541-478e-940b-888ad15d41d6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:16:07.053776 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-b029891c-e541-478e-940b-888ad15d41d6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 287e8432-d3b2-40f6-8ade-2269cb44ce5b] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:16:07.060974 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b029891c-e541-478e-940b-888ad15d41d6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:07.061452 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b029891c-e541-478e-940b-888ad15d41d6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:07.062215 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b029891c-e541-478e-940b-888ad15d41d6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:07.062653 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b029891c-e541-478e-940b-888ad15d41d6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:07.142751 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.objects.instance [None req-b029891c-e541-478e-940b-888ad15d41d6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lazy-loading 'services' on Instance uuid 287e8432-d3b2-40f6-8ade-2269cb44ce5b {{(pid=118409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 23:16:07.350146 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-b029891c-e541-478e-940b-888ad15d41d6 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "DELETE /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b/os-volume_attachments/ff6c35ab-1ea1-493b-83c0-2f6a366cdfca" status: 202 len: 0 microversion: 2.1 time: 0.301348 Jul 25 23:16:07.350663 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 509/1021] 10.222.0.55 () {58 vars in 1416 bytes} [Mon Jul 25 23:16:07 2022] DELETE /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b/os-volume_attachments/ff6c35ab-1ea1-493b-83c0-2f6a366cdfca => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 23:16:07.360871 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-592a90e2-1e9c-43ed-8e83-0a6fde5670c5 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:16:07.366431 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-592a90e2-1e9c-43ed-8e83-0a6fde5670c5 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 287e8432-d3b2-40f6-8ade-2269cb44ce5b] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:16:07.370021 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-592a90e2-1e9c-43ed-8e83-0a6fde5670c5 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:07.370910 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-592a90e2-1e9c-43ed-8e83-0a6fde5670c5 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:07.371704 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-592a90e2-1e9c-43ed-8e83-0a6fde5670c5 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:07.372144 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-592a90e2-1e9c-43ed-8e83-0a6fde5670c5 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:07.402079 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-592a90e2-1e9c-43ed-8e83-0a6fde5670c5 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046262 Jul 25 23:16:07.402634 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 513/1022] 10.222.0.55 () {58 vars in 1302 bytes} [Mon Jul 25 23:16:07 2022] GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 23:16:08.415001 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-83ca29fa-07b9-409f-959b-4004a0123d61 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:16:08.418107 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-83ca29fa-07b9-409f-959b-4004a0123d61 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 287e8432-d3b2-40f6-8ade-2269cb44ce5b] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:16:08.424433 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-83ca29fa-07b9-409f-959b-4004a0123d61 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:08.424883 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-83ca29fa-07b9-409f-959b-4004a0123d61 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:08.425691 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-83ca29fa-07b9-409f-959b-4004a0123d61 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:08.426129 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-83ca29fa-07b9-409f-959b-4004a0123d61 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:08.456724 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-83ca29fa-07b9-409f-959b-4004a0123d61 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046419 Jul 25 23:16:08.457254 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 510/1023] 10.222.0.55 () {58 vars in 1302 bytes} [Mon Jul 25 23:16:08 2022] GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 25 23:16:08.526623 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-9b193c22-74d9-4010-841d-6044d8cb0ec9 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:16:08.527136 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-9b193c22-74d9-4010-841d-6044d8cb0ec9 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 287e8432-d3b2-40f6-8ade-2269cb44ce5b] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:16:08.533744 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9b193c22-74d9-4010-841d-6044d8cb0ec9 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:08.534197 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9b193c22-74d9-4010-841d-6044d8cb0ec9 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:08.534962 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9b193c22-74d9-4010-841d-6044d8cb0ec9 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:08.535398 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9b193c22-74d9-4010-841d-6044d8cb0ec9 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:08.562716 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-9b193c22-74d9-4010-841d-6044d8cb0ec9 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 287e8432-d3b2-40f6-8ade-2269cb44ce5b] Going to try to terminate instance {{(pid=118410) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 23:16:08.842887 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-9b193c22-74d9-4010-841d-6044d8cb0ec9 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "DELETE /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b" status: 204 len: 0 microversion: 2.1 time: 0.321839 Jul 25 23:16:08.843529 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 514/1024] 10.222.0.55 () {58 vars in 1239 bytes} [Mon Jul 25 23:16:08 2022] DELETE /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 23:16:08.851818 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-eb5fbdc9-5937-44e6-aaff-dc9a2adcdc1b tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:16:08.852429 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-eb5fbdc9-5937-44e6-aaff-dc9a2adcdc1b tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 287e8432-d3b2-40f6-8ade-2269cb44ce5b] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:16:08.858920 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-eb5fbdc9-5937-44e6-aaff-dc9a2adcdc1b tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:08.859380 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-eb5fbdc9-5937-44e6-aaff-dc9a2adcdc1b tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:08.860215 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-eb5fbdc9-5937-44e6-aaff-dc9a2adcdc1b tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:08.860885 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-eb5fbdc9-5937-44e6-aaff-dc9a2adcdc1b tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:08.996280 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-eb5fbdc9-5937-44e6-aaff-dc9a2adcdc1b tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:16:09.007429 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-eb5fbdc9-5937-44e6-aaff-dc9a2adcdc1b tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b" status: 200 len: 1680 microversion: 2.1 time: 0.159492 Jul 25 23:16:09.007990 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 511/1025] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:16:08 2022] GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:16:10.031020 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-3b06b8a7-7399-41a2-ba9e-9b639c4059a0 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:16:10.031716 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-3b06b8a7-7399-41a2-ba9e-9b639c4059a0 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 287e8432-d3b2-40f6-8ade-2269cb44ce5b] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:16:10.038463 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3b06b8a7-7399-41a2-ba9e-9b639c4059a0 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:10.038913 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3b06b8a7-7399-41a2-ba9e-9b639c4059a0 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:10.039688 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3b06b8a7-7399-41a2-ba9e-9b639c4059a0 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:10.040125 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3b06b8a7-7399-41a2-ba9e-9b639c4059a0 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:10.170661 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-3b06b8a7-7399-41a2-ba9e-9b639c4059a0 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:16:10.178164 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-3b06b8a7-7399-41a2-ba9e-9b639c4059a0 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b" status: 200 len: 1680 microversion: 2.1 time: 0.151398 Jul 25 23:16:10.178722 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 515/1026] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:16:10 2022] GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:16:11.200175 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-56b89b4b-47ac-4b9f-b3db-d3a87ddf310e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:16:11.200787 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-56b89b4b-47ac-4b9f-b3db-d3a87ddf310e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 287e8432-d3b2-40f6-8ade-2269cb44ce5b] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:16:11.207369 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-56b89b4b-47ac-4b9f-b3db-d3a87ddf310e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:11.207818 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-56b89b4b-47ac-4b9f-b3db-d3a87ddf310e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:11.208585 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-56b89b4b-47ac-4b9f-b3db-d3a87ddf310e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:11.209023 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-56b89b4b-47ac-4b9f-b3db-d3a87ddf310e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:11.299838 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-56b89b4b-47ac-4b9f-b3db-d3a87ddf310e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:16:11.307867 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-56b89b4b-47ac-4b9f-b3db-d3a87ddf310e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b" status: 200 len: 1612 microversion: 2.1 time: 0.112171 Jul 25 23:16:11.308439 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 512/1027] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:16:11 2022] GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b => generated 1612 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:16:11.380480 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-df161611-82fb-4393-9131-8ad898f1a5e6 req-d15d8bf1-05b8-4f23-bfba-189323f56548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "287e8432-d3b2-40f6-8ade-2269cb44ce5b", "name": "network-vif-deleted", "tag": "0ac21e88-e7df-4fa4-93d4-dd0428cdb04f"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:16:11.391110 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-df161611-82fb-4393-9131-8ad898f1a5e6 req-d15d8bf1-05b8-4f23-bfba-189323f56548 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:11.401150 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-df161611-82fb-4393-9131-8ad898f1a5e6 req-d15d8bf1-05b8-4f23-bfba-189323f56548 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:11.403921 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-df161611-82fb-4393-9131-8ad898f1a5e6 req-d15d8bf1-05b8-4f23-bfba-189323f56548 service nova] Creating event network-vif-deleted:0ac21e88-e7df-4fa4-93d4-dd0428cdb04f for instance 287e8432-d3b2-40f6-8ade-2269cb44ce5b on hv-cinder-79760 Jul 25 23:16:11.408873 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-df161611-82fb-4393-9131-8ad898f1a5e6 req-d15d8bf1-05b8-4f23-bfba-189323f56548 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032181 Jul 25 23:16:11.409546 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 516/1028] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:16:12.329412 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-211aaa0c-740b-4931-834e-dff39e611959 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:16:12.330021 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-211aaa0c-740b-4931-834e-dff39e611959 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 287e8432-d3b2-40f6-8ade-2269cb44ce5b] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:16:12.336401 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-211aaa0c-740b-4931-834e-dff39e611959 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:12.336827 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-211aaa0c-740b-4931-834e-dff39e611959 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:12.337725 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-211aaa0c-740b-4931-834e-dff39e611959 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:12.338181 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-211aaa0c-740b-4931-834e-dff39e611959 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:12.370005 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-211aaa0c-740b-4931-834e-dff39e611959 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:12.370457 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-211aaa0c-740b-4931-834e-dff39e611959 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:12.370902 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.objects.instance [None req-211aaa0c-740b-4931-834e-dff39e611959 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lazy-loading 'fault' on Instance uuid 287e8432-d3b2-40f6-8ade-2269cb44ce5b {{(pid=118409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 23:16:12.416216 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-211aaa0c-740b-4931-834e-dff39e611959 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54ad4a554de414a80ed03d62c1eb3a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bca196a6befb4fae9531dc96a1e58d5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:16:12.423064 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-211aaa0c-740b-4931-834e-dff39e611959 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b" status: 200 len: 1331 microversion: 2.1 time: 0.097637 Jul 25 23:16:12.423619 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 513/1029] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:16:12 2022] GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b => generated 1331 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:16:13.444845 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-249450df-d2d4-4a1f-91da-dcc71d759fd8 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:16:13.445570 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-249450df-d2d4-4a1f-91da-dcc71d759fd8 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 287e8432-d3b2-40f6-8ade-2269cb44ce5b] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:16:13.452447 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-249450df-d2d4-4a1f-91da-dcc71d759fd8 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:13.452885 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-249450df-d2d4-4a1f-91da-dcc71d759fd8 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:13.453668 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-249450df-d2d4-4a1f-91da-dcc71d759fd8 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:13.454099 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-249450df-d2d4-4a1f-91da-dcc71d759fd8 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:13.467713 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-249450df-d2d4-4a1f-91da-dcc71d759fd8 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] HTTP exception thrown: Instance 287e8432-d3b2-40f6-8ade-2269cb44ce5b could not be found. Jul 25 23:16:13.469333 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-249450df-d2d4-4a1f-91da-dcc71d759fd8 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Request method failure captured: Jul 25 23:16:13.469333 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b HTTP/1.1 Jul 25 23:16:13.469333 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 25 23:16:13.469333 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 25 23:16:13.469333 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Connection: close Jul 25 23:16:13.469333 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 25 23:16:13.469333 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 25 23:16:13.469333 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Host: 10.222.0.55 Jul 25 23:16:13.469333 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 25 23:16:13.469333 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.10 Jul 25 23:16:13.469333 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABi3yMnWBF6N7ojia5nXsORomJKEubbLBv0vxCjlfVfsMo4Tn2EFSjvpY4M7xgoUAXGyz8xdNhwjA2Y6j5eYhzQSRo3SbffFPsEnm8ehR5gzh2aHTMOW72yy4L7WJZWPo5TX3ANcF5axUZPg2syZaiRay85nhAKbscEZHRDYy-zr1KSX8Y Jul 25 23:16:13.469333 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 25 23:16:13.469333 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 25 23:16:13.469333 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 25 23:16:13.469333 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 25 23:16:13.469333 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 25 23:16:13.469333 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 25 23:16:13.469333 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Id: bca196a6befb4fae9531dc96a1e58d5f Jul 25 23:16:13.469333 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:16:13.469333 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Role: reader,member Jul 25 23:16:13.469333 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Roles: reader,member Jul 25 23:16:13.470955 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_bca196a6befb4fae9531dc96a1e58d5f", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:16:13.470955 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:16:13.470955 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Id: bca196a6befb4fae9531dc96a1e58d5f Jul 25 23:16:13.470955 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:16:13.470955 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User: tempest-AttachVolumeNegativeTest-920481926-project Jul 25 23:16:13.470955 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 25 23:16:13.470955 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 25 23:16:13.470955 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Id: f54ad4a554de414a80ed03d62c1eb3a5 Jul 25 23:16:13.470955 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-AttachVolumeNegativeTest-920481926-project Jul 25 23:16:13.470955 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: method: > Jul 25 23:16:13.470955 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: exception: Instance 287e8432-d3b2-40f6-8ade-2269cb44ce5b could not be found. Jul 25 23:16:13.470955 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: action_args: {'id': '287e8432-d3b2-40f6-8ade-2269cb44ce5b'} Jul 25 23:16:13.471871 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:16:13.471871 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:16:13.471871 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:16:13.471871 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:16:13.471871 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:16:13.471871 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:16:13.471871 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:16:13.471871 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:16:13.471871 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:16:13.471871 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:16:13.471871 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 287e8432-d3b2-40f6-8ade-2269cb44ce5b could not be found. Jul 25 23:16:13.471871 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:16:13.471871 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:16:13.471871 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:16:13.471871 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:16:13.471871 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:16:13.471871 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:16:13.471871 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:16:13.471871 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:16:13.471871 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:16:13.473207 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:16:13.473207 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 23:16:13.473207 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 23:16:13.473207 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:16:13.473207 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:16:13.473207 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:16:13.473207 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:16:13.473207 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 287e8432-d3b2-40f6-8ade-2269cb44ce5b could not be found. Jul 25 23:16:13.473207 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:16:13.473207 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:16:13.473207 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:16:13.473207 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:16:13.473207 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:16:13.473207 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:16:13.473207 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:16:13.473207 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:16:13.473207 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 287e8432-d3b2-40f6-8ade-2269cb44ce5b could not be found. Jul 25 23:16:13.473207 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:16:13.474358 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-249450df-d2d4-4a1f-91da-dcc71d759fd8 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Returning 404 to user: Instance 287e8432-d3b2-40f6-8ade-2269cb44ce5b could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:16:13.474358 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-249450df-d2d4-4a1f-91da-dcc71d759fd8 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b" status: 404 len: 111 microversion: 2.1 time: 0.030530 Jul 25 23:16:13.474358 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 517/1030] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:16:13 2022] GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:16:13.479449 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-4e37edc0-01d9-4aa9-9eee-93ff57677222 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '.version_select at 0x7f6226fb2ca0>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:16:13.710197 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-4e37edc0-01d9-4aa9-9eee-93ff57677222 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-136581029" status: 202 len: 0 microversion: 2.1 time: 0.234293 Jul 25 23:16:13.710733 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 514/1031] 10.222.0.55 () {58 vars in 1218 bytes} [Mon Jul 25 23:16:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-136581029 => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 23:16:15.740790 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a4114482-860c-4036-a9d9-ce2daa218589 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:16:15.741428 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-a4114482-860c-4036-a9d9-ce2daa218589 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 287e8432-d3b2-40f6-8ade-2269cb44ce5b] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:16:15.749045 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a4114482-860c-4036-a9d9-ce2daa218589 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:15.749525 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a4114482-860c-4036-a9d9-ce2daa218589 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:15.750288 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a4114482-860c-4036-a9d9-ce2daa218589 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:15.750738 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-a4114482-860c-4036-a9d9-ce2daa218589 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:15.764731 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-a4114482-860c-4036-a9d9-ce2daa218589 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] HTTP exception thrown: Instance 287e8432-d3b2-40f6-8ade-2269cb44ce5b could not be found. Jul 25 23:16:15.766328 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a4114482-860c-4036-a9d9-ce2daa218589 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Request method failure captured: Jul 25 23:16:15.766328 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: request: DELETE /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b HTTP/1.1 Jul 25 23:16:15.766328 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 25 23:16:15.766328 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 25 23:16:15.766328 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Connection: close Jul 25 23:16:15.766328 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 25 23:16:15.766328 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 25 23:16:15.766328 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Host: 10.222.0.55 Jul 25 23:16:15.766328 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 25 23:16:15.766328 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.10 Jul 25 23:16:15.766328 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABi3yMnWBF6N7ojia5nXsORomJKEubbLBv0vxCjlfVfsMo4Tn2EFSjvpY4M7xgoUAXGyz8xdNhwjA2Y6j5eYhzQSRo3SbffFPsEnm8ehR5gzh2aHTMOW72yy4L7WJZWPo5TX3ANcF5axUZPg2syZaiRay85nhAKbscEZHRDYy-zr1KSX8Y Jul 25 23:16:15.766328 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 25 23:16:15.766328 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 25 23:16:15.766328 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 25 23:16:15.766328 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 25 23:16:15.766328 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 25 23:16:15.766328 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 25 23:16:15.766328 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Id: bca196a6befb4fae9531dc96a1e58d5f Jul 25 23:16:15.766328 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:16:15.766328 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Role: reader,member Jul 25 23:16:15.766328 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Roles: reader,member Jul 25 23:16:15.767979 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_bca196a6befb4fae9531dc96a1e58d5f", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:16:15.767979 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:16:15.767979 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Id: bca196a6befb4fae9531dc96a1e58d5f Jul 25 23:16:15.767979 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:16:15.767979 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User: tempest-AttachVolumeNegativeTest-920481926-project Jul 25 23:16:15.767979 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 25 23:16:15.767979 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 25 23:16:15.767979 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Id: f54ad4a554de414a80ed03d62c1eb3a5 Jul 25 23:16:15.767979 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-AttachVolumeNegativeTest-920481926-project Jul 25 23:16:15.767979 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: method: > Jul 25 23:16:15.767979 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: exception: Instance 287e8432-d3b2-40f6-8ade-2269cb44ce5b could not be found. Jul 25 23:16:15.767979 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: action_args: {'id': '287e8432-d3b2-40f6-8ade-2269cb44ce5b'} Jul 25 23:16:15.769101 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:16:15.769101 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:16:15.769101 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:16:15.769101 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:16:15.769101 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:16:15.769101 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:16:15.769101 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:16:15.769101 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:16:15.769101 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:16:15.769101 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:16:15.769101 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 287e8432-d3b2-40f6-8ade-2269cb44ce5b could not be found. Jul 25 23:16:15.769101 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:16:15.769101 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:16:15.769101 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:16:15.769101 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:16:15.769101 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:16:15.769101 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:16:15.769101 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:16:15.769101 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:16:15.769101 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:16:15.770717 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:16:15.770717 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 23:16:15.770717 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 23:16:15.770717 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 23:16:15.770717 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 23:16:15.770717 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:16:15.770717 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:16:15.770717 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:16:15.770717 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:16:15.770717 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 287e8432-d3b2-40f6-8ade-2269cb44ce5b could not be found. Jul 25 23:16:15.770717 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:16:15.770717 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:16:15.770717 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:16:15.770717 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:16:15.770717 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:16:15.770717 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:16:15.770717 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:16:15.770717 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:16:15.770717 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 287e8432-d3b2-40f6-8ade-2269cb44ce5b could not be found. Jul 25 23:16:15.770717 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:16:15.772329 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-a4114482-860c-4036-a9d9-ce2daa218589 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Returning 404 to user: Instance 287e8432-d3b2-40f6-8ade-2269cb44ce5b could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:16:15.772329 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-a4114482-860c-4036-a9d9-ce2daa218589 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "DELETE /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b" status: 404 len: 111 microversion: 2.1 time: 0.031474 Jul 25 23:16:15.772329 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 518/1032] 10.222.0.55 () {58 vars in 1239 bytes} [Mon Jul 25 23:16:15 2022] DELETE /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:16:15.777077 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-e2e13f7c-5f5e-4c4c-ae92-10c3bf845e62 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:16:15.777701 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-e2e13f7c-5f5e-4c4c-ae92-10c3bf845e62 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 287e8432-d3b2-40f6-8ade-2269cb44ce5b] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:16:15.784314 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e2e13f7c-5f5e-4c4c-ae92-10c3bf845e62 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:15.784755 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e2e13f7c-5f5e-4c4c-ae92-10c3bf845e62 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:15.785546 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e2e13f7c-5f5e-4c4c-ae92-10c3bf845e62 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:15.785980 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e2e13f7c-5f5e-4c4c-ae92-10c3bf845e62 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:15.800056 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.wsgi [None req-e2e13f7c-5f5e-4c4c-ae92-10c3bf845e62 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] HTTP exception thrown: Instance 287e8432-d3b2-40f6-8ade-2269cb44ce5b could not be found. Jul 25 23:16:15.801728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-e2e13f7c-5f5e-4c4c-ae92-10c3bf845e62 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Request method failure captured: Jul 25 23:16:15.801728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: request: GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b HTTP/1.1 Jul 25 23:16:15.801728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept: application/json Jul 25 23:16:15.801728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept-Encoding: identity Jul 25 23:16:15.801728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Connection: close Jul 25 23:16:15.801728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Length: 0 Jul 25 23:16:15.801728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Type: application/json Jul 25 23:16:15.801728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Host: 10.222.0.55 Jul 25 23:16:15.801728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Openstack-System-Scope: None Jul 25 23:16:15.801728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: User-Agent: python-urllib3/1.26.10 Jul 25 23:16:15.801728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Auth-Token: gAAAAABi3yMnWBF6N7ojia5nXsORomJKEubbLBv0vxCjlfVfsMo4Tn2EFSjvpY4M7xgoUAXGyz8xdNhwjA2Y6j5eYhzQSRo3SbffFPsEnm8ehR5gzh2aHTMOW72yy4L7WJZWPo5TX3ANcF5axUZPg2syZaiRay85nhAKbscEZHRDYy-zr1KSX8Y Jul 25 23:16:15.801728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Id: None Jul 25 23:16:15.801728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Name: None Jul 25 23:16:15.801728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Identity-Status: Confirmed Jul 25 23:16:15.801728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Is-Admin-Project: True Jul 25 23:16:15.801728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Id: default Jul 25 23:16:15.801728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Name: Default Jul 25 23:16:15.801728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Id: bca196a6befb4fae9531dc96a1e58d5f Jul 25 23:16:15.801728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Name: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:16:15.801728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Role: reader,member Jul 25 23:16:15.801728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Roles: reader,member Jul 25 23:16:15.803481 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_bca196a6befb4fae9531dc96a1e58d5f", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:16:15.803481 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:16:15.803481 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Id: bca196a6befb4fae9531dc96a1e58d5f Jul 25 23:16:15.803481 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:16:15.803481 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User: tempest-AttachVolumeNegativeTest-920481926-project Jul 25 23:16:15.803481 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Id: default Jul 25 23:16:15.803481 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Name: Default Jul 25 23:16:15.803481 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Id: f54ad4a554de414a80ed03d62c1eb3a5 Jul 25 23:16:15.803481 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Name: tempest-AttachVolumeNegativeTest-920481926-project Jul 25 23:16:15.803481 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: method: > Jul 25 23:16:15.803481 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: exception: Instance 287e8432-d3b2-40f6-8ade-2269cb44ce5b could not be found. Jul 25 23:16:15.803481 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: action_args: {'id': '287e8432-d3b2-40f6-8ade-2269cb44ce5b'} Jul 25 23:16:15.804408 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:16:15.804408 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:16:15.804408 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:16:15.804408 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:16:15.804408 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:16:15.804408 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:16:15.804408 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:16:15.804408 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:16:15.804408 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:16:15.804408 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:16:15.804408 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 287e8432-d3b2-40f6-8ade-2269cb44ce5b could not be found. Jul 25 23:16:15.804408 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:16:15.804408 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:16:15.804408 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:16:15.804408 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:16:15.804408 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:16:15.804408 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:16:15.804408 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:16:15.804408 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:16:15.804408 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:16:15.805817 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:16:15.805817 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 23:16:15.805817 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 23:16:15.805817 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:16:15.805817 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:16:15.805817 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:16:15.805817 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:16:15.805817 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 287e8432-d3b2-40f6-8ade-2269cb44ce5b could not be found. Jul 25 23:16:15.805817 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:16:15.805817 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:16:15.805817 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:16:15.805817 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:16:15.805817 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:16:15.805817 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:16:15.805817 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:16:15.805817 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:16:15.805817 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 287e8432-d3b2-40f6-8ade-2269cb44ce5b could not be found. Jul 25 23:16:15.805817 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:16:15.807428 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-e2e13f7c-5f5e-4c4c-ae92-10c3bf845e62 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Returning 404 to user: Instance 287e8432-d3b2-40f6-8ade-2269cb44ce5b could not be found. {{(pid=118409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:16:15.807428 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-e2e13f7c-5f5e-4c4c-ae92-10c3bf845e62 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b" status: 404 len: 111 microversion: 2.1 time: 0.030918 Jul 25 23:16:15.807428 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 515/1033] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:16:15 2022] GET /compute/v2.1/servers/287e8432-d3b2-40f6-8ade-2269cb44ce5b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:16:17.092395 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c0d3181a-2af4-4fd6-808e-b0086e352a11 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:16:17.092884 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c0d3181a-2af4-4fd6-808e-b0086e352a11 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d442d7e2-afaf-4db1-8130-b13d2f5cc7e9] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:16:17.099401 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c0d3181a-2af4-4fd6-808e-b0086e352a11 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:17.105876 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c0d3181a-2af4-4fd6-808e-b0086e352a11 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:17.105876 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c0d3181a-2af4-4fd6-808e-b0086e352a11 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:17.105876 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c0d3181a-2af4-4fd6-808e-b0086e352a11 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:17.115128 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-c0d3181a-2af4-4fd6-808e-b0086e352a11 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] HTTP exception thrown: Instance d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 could not be found. Jul 25 23:16:17.116578 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c0d3181a-2af4-4fd6-808e-b0086e352a11 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Request method failure captured: Jul 25 23:16:17.116578 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: request: DELETE /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 HTTP/1.1 Jul 25 23:16:17.116578 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 25 23:16:17.116578 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 25 23:16:17.116578 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Connection: close Jul 25 23:16:17.116578 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 25 23:16:17.116578 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 25 23:16:17.116578 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Host: 10.222.0.55 Jul 25 23:16:17.116578 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 25 23:16:17.116578 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.10 Jul 25 23:16:17.116578 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABi3yMnWBF6N7ojia5nXsORomJKEubbLBv0vxCjlfVfsMo4Tn2EFSjvpY4M7xgoUAXGyz8xdNhwjA2Y6j5eYhzQSRo3SbffFPsEnm8ehR5gzh2aHTMOW72yy4L7WJZWPo5TX3ANcF5axUZPg2syZaiRay85nhAKbscEZHRDYy-zr1KSX8Y Jul 25 23:16:17.116578 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 25 23:16:17.116578 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 25 23:16:17.116578 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 25 23:16:17.116578 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 25 23:16:17.116578 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 25 23:16:17.116578 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 25 23:16:17.116578 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Id: bca196a6befb4fae9531dc96a1e58d5f Jul 25 23:16:17.116578 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:16:17.116578 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Role: reader,member Jul 25 23:16:17.116578 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Roles: reader,member Jul 25 23:16:17.118200 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_bca196a6befb4fae9531dc96a1e58d5f", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:16:17.118200 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:16:17.118200 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Id: bca196a6befb4fae9531dc96a1e58d5f Jul 25 23:16:17.118200 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:16:17.118200 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User: tempest-AttachVolumeNegativeTest-920481926-project Jul 25 23:16:17.118200 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 25 23:16:17.118200 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 25 23:16:17.118200 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Id: f54ad4a554de414a80ed03d62c1eb3a5 Jul 25 23:16:17.118200 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-AttachVolumeNegativeTest-920481926-project Jul 25 23:16:17.118200 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: method: > Jul 25 23:16:17.118200 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: exception: Instance d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 could not be found. Jul 25 23:16:17.118200 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: action_args: {'id': 'd442d7e2-afaf-4db1-8130-b13d2f5cc7e9'} Jul 25 23:16:17.119735 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:16:17.119735 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:16:17.119735 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:16:17.119735 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:16:17.119735 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:16:17.119735 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:16:17.119735 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:16:17.119735 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:16:17.119735 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:16:17.119735 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:16:17.119735 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 could not be found. Jul 25 23:16:17.119735 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:16:17.119735 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:16:17.119735 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:16:17.119735 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:16:17.119735 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:16:17.119735 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:16:17.119735 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:16:17.119735 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:16:17.119735 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:16:17.121238 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:16:17.121238 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 23:16:17.121238 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 23:16:17.121238 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 23:16:17.121238 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 23:16:17.121238 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:16:17.121238 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:16:17.121238 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:16:17.121238 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:16:17.121238 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 could not be found. Jul 25 23:16:17.121238 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:16:17.121238 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:16:17.121238 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:16:17.121238 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:16:17.121238 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:16:17.121238 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:16:17.121238 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:16:17.121238 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:16:17.121238 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 could not be found. Jul 25 23:16:17.121238 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:16:17.122720 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c0d3181a-2af4-4fd6-808e-b0086e352a11 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Returning 404 to user: Instance d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:16:17.122720 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c0d3181a-2af4-4fd6-808e-b0086e352a11 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "DELETE /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9" status: 404 len: 111 microversion: 2.1 time: 0.029461 Jul 25 23:16:17.122720 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 519/1034] 10.222.0.55 () {58 vars in 1239 bytes} [Mon Jul 25 23:16:17 2022] DELETE /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:16:17.127100 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-ee1e6571-63ef-4e8c-a59c-eb9226396f94 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:16:17.127711 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-ee1e6571-63ef-4e8c-a59c-eb9226396f94 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d442d7e2-afaf-4db1-8130-b13d2f5cc7e9] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:16:17.134238 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ee1e6571-63ef-4e8c-a59c-eb9226396f94 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:17.134685 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ee1e6571-63ef-4e8c-a59c-eb9226396f94 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:17.135457 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ee1e6571-63ef-4e8c-a59c-eb9226396f94 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:17.135887 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ee1e6571-63ef-4e8c-a59c-eb9226396f94 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:17.149363 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.wsgi [None req-ee1e6571-63ef-4e8c-a59c-eb9226396f94 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] HTTP exception thrown: Instance d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 could not be found. Jul 25 23:16:17.151100 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-ee1e6571-63ef-4e8c-a59c-eb9226396f94 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Request method failure captured: Jul 25 23:16:17.151100 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: request: GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 HTTP/1.1 Jul 25 23:16:17.151100 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept: application/json Jul 25 23:16:17.151100 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept-Encoding: identity Jul 25 23:16:17.151100 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Connection: close Jul 25 23:16:17.151100 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Length: 0 Jul 25 23:16:17.151100 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Type: application/json Jul 25 23:16:17.151100 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Host: 10.222.0.55 Jul 25 23:16:17.151100 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Openstack-System-Scope: None Jul 25 23:16:17.151100 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: User-Agent: python-urllib3/1.26.10 Jul 25 23:16:17.151100 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Auth-Token: gAAAAABi3yMnWBF6N7ojia5nXsORomJKEubbLBv0vxCjlfVfsMo4Tn2EFSjvpY4M7xgoUAXGyz8xdNhwjA2Y6j5eYhzQSRo3SbffFPsEnm8ehR5gzh2aHTMOW72yy4L7WJZWPo5TX3ANcF5axUZPg2syZaiRay85nhAKbscEZHRDYy-zr1KSX8Y Jul 25 23:16:17.151100 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Id: None Jul 25 23:16:17.151100 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Name: None Jul 25 23:16:17.151100 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Identity-Status: Confirmed Jul 25 23:16:17.151100 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Is-Admin-Project: True Jul 25 23:16:17.151100 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Id: default Jul 25 23:16:17.151100 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Name: Default Jul 25 23:16:17.151100 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Id: bca196a6befb4fae9531dc96a1e58d5f Jul 25 23:16:17.151100 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Name: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:16:17.151100 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Role: reader,member Jul 25 23:16:17.151100 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Roles: reader,member Jul 25 23:16:17.152671 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_bca196a6befb4fae9531dc96a1e58d5f", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:16:17.152671 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:16:17.152671 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Id: bca196a6befb4fae9531dc96a1e58d5f Jul 25 23:16:17.152671 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:16:17.152671 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User: tempest-AttachVolumeNegativeTest-920481926-project Jul 25 23:16:17.152671 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Id: default Jul 25 23:16:17.152671 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Name: Default Jul 25 23:16:17.152671 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Id: f54ad4a554de414a80ed03d62c1eb3a5 Jul 25 23:16:17.152671 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Name: tempest-AttachVolumeNegativeTest-920481926-project Jul 25 23:16:17.152671 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: method: > Jul 25 23:16:17.152671 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: exception: Instance d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 could not be found. Jul 25 23:16:17.152671 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: action_args: {'id': 'd442d7e2-afaf-4db1-8130-b13d2f5cc7e9'} Jul 25 23:16:17.153730 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:16:17.153730 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:16:17.153730 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:16:17.153730 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:16:17.153730 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:16:17.153730 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:16:17.153730 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:16:17.153730 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:16:17.153730 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:16:17.153730 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:16:17.153730 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 could not be found. Jul 25 23:16:17.153730 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:16:17.153730 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:16:17.153730 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:16:17.153730 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:16:17.153730 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:16:17.153730 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:16:17.153730 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:16:17.153730 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:16:17.153730 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:16:17.155253 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:16:17.155253 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 23:16:17.155253 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 23:16:17.155253 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:16:17.155253 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:16:17.155253 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:16:17.155253 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:16:17.155253 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 could not be found. Jul 25 23:16:17.155253 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:16:17.155253 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:16:17.155253 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:16:17.155253 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:16:17.155253 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:16:17.155253 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:16:17.155253 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:16:17.155253 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:16:17.155253 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 could not be found. Jul 25 23:16:17.155253 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:16:17.156727 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-ee1e6571-63ef-4e8c-a59c-eb9226396f94 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Returning 404 to user: Instance d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 could not be found. {{(pid=118409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:16:17.156727 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-ee1e6571-63ef-4e8c-a59c-eb9226396f94 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9" status: 404 len: 111 microversion: 2.1 time: 0.029240 Jul 25 23:16:17.156727 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 516/1035] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:16:17 2022] GET /compute/v2.1/servers/d442d7e2-afaf-4db1-8130-b13d2f5cc7e9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:16:17.160871 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-96afcfde-6dff-4aeb-ac92-f83a4989502f tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:16:17.161393 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-96afcfde-6dff-4aeb-ac92-f83a4989502f tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 6da72d7b-eb7f-4135-97e0-49f603ac903d] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:16:17.168074 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-96afcfde-6dff-4aeb-ac92-f83a4989502f tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:17.172834 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-96afcfde-6dff-4aeb-ac92-f83a4989502f tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:17.172834 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-96afcfde-6dff-4aeb-ac92-f83a4989502f tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:17.172834 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-96afcfde-6dff-4aeb-ac92-f83a4989502f tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:17.183767 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-96afcfde-6dff-4aeb-ac92-f83a4989502f tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] HTTP exception thrown: Instance 6da72d7b-eb7f-4135-97e0-49f603ac903d could not be found. Jul 25 23:16:17.185327 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-96afcfde-6dff-4aeb-ac92-f83a4989502f tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Request method failure captured: Jul 25 23:16:17.185327 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: request: DELETE /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d HTTP/1.1 Jul 25 23:16:17.185327 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 25 23:16:17.185327 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 25 23:16:17.185327 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Connection: close Jul 25 23:16:17.185327 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 25 23:16:17.185327 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 25 23:16:17.185327 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Host: 10.222.0.55 Jul 25 23:16:17.185327 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 25 23:16:17.185327 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.10 Jul 25 23:16:17.185327 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABi3yMnWBF6N7ojia5nXsORomJKEubbLBv0vxCjlfVfsMo4Tn2EFSjvpY4M7xgoUAXGyz8xdNhwjA2Y6j5eYhzQSRo3SbffFPsEnm8ehR5gzh2aHTMOW72yy4L7WJZWPo5TX3ANcF5axUZPg2syZaiRay85nhAKbscEZHRDYy-zr1KSX8Y Jul 25 23:16:17.185327 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 25 23:16:17.185327 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 25 23:16:17.185327 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 25 23:16:17.185327 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 25 23:16:17.185327 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 25 23:16:17.185327 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 25 23:16:17.185327 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Id: bca196a6befb4fae9531dc96a1e58d5f Jul 25 23:16:17.185327 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:16:17.185327 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Role: reader,member Jul 25 23:16:17.185327 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Roles: reader,member Jul 25 23:16:17.186909 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_bca196a6befb4fae9531dc96a1e58d5f", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:16:17.186909 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:16:17.186909 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Id: bca196a6befb4fae9531dc96a1e58d5f Jul 25 23:16:17.186909 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:16:17.186909 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User: tempest-AttachVolumeNegativeTest-920481926-project Jul 25 23:16:17.186909 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 25 23:16:17.186909 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 25 23:16:17.186909 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Id: f54ad4a554de414a80ed03d62c1eb3a5 Jul 25 23:16:17.186909 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-AttachVolumeNegativeTest-920481926-project Jul 25 23:16:17.186909 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: method: > Jul 25 23:16:17.186909 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: exception: Instance 6da72d7b-eb7f-4135-97e0-49f603ac903d could not be found. Jul 25 23:16:17.186909 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: action_args: {'id': '6da72d7b-eb7f-4135-97e0-49f603ac903d'} Jul 25 23:16:17.188043 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:16:17.188043 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:16:17.188043 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:16:17.188043 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:16:17.188043 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:16:17.188043 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:16:17.188043 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:16:17.188043 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:16:17.188043 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:16:17.188043 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:16:17.188043 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6da72d7b-eb7f-4135-97e0-49f603ac903d could not be found. Jul 25 23:16:17.188043 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:16:17.188043 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:16:17.188043 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:16:17.188043 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:16:17.188043 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:16:17.188043 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:16:17.188043 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:16:17.188043 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:16:17.188043 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:16:17.189615 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:16:17.189615 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 23:16:17.189615 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 23:16:17.189615 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 23:16:17.189615 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 23:16:17.189615 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:16:17.189615 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:16:17.189615 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:16:17.189615 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:16:17.189615 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6da72d7b-eb7f-4135-97e0-49f603ac903d could not be found. Jul 25 23:16:17.189615 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:16:17.189615 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:16:17.189615 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:16:17.189615 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:16:17.189615 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:16:17.189615 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:16:17.189615 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:16:17.189615 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:16:17.189615 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6da72d7b-eb7f-4135-97e0-49f603ac903d could not be found. Jul 25 23:16:17.189615 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:16:17.191206 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-96afcfde-6dff-4aeb-ac92-f83a4989502f tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Returning 404 to user: Instance 6da72d7b-eb7f-4135-97e0-49f603ac903d could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:16:17.191206 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-96afcfde-6dff-4aeb-ac92-f83a4989502f tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "DELETE /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d" status: 404 len: 111 microversion: 2.1 time: 0.029659 Jul 25 23:16:17.191206 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 520/1036] 10.222.0.55 () {58 vars in 1239 bytes} [Mon Jul 25 23:16:17 2022] DELETE /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:16:17.194771 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-e9ea6950-5502-41d3-96a4-a3f3faa3b177 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:16:17.195374 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-e9ea6950-5502-41d3-96a4-a3f3faa3b177 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: 6da72d7b-eb7f-4135-97e0-49f603ac903d] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:16:17.201551 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e9ea6950-5502-41d3-96a4-a3f3faa3b177 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:17.201990 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e9ea6950-5502-41d3-96a4-a3f3faa3b177 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:17.202738 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e9ea6950-5502-41d3-96a4-a3f3faa3b177 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:17.203165 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e9ea6950-5502-41d3-96a4-a3f3faa3b177 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:17.218012 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.wsgi [None req-e9ea6950-5502-41d3-96a4-a3f3faa3b177 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] HTTP exception thrown: Instance 6da72d7b-eb7f-4135-97e0-49f603ac903d could not be found. Jul 25 23:16:17.219502 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-e9ea6950-5502-41d3-96a4-a3f3faa3b177 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Request method failure captured: Jul 25 23:16:17.219502 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: request: GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d HTTP/1.1 Jul 25 23:16:17.219502 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept: application/json Jul 25 23:16:17.219502 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept-Encoding: identity Jul 25 23:16:17.219502 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Connection: close Jul 25 23:16:17.219502 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Length: 0 Jul 25 23:16:17.219502 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Type: application/json Jul 25 23:16:17.219502 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Host: 10.222.0.55 Jul 25 23:16:17.219502 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Openstack-System-Scope: None Jul 25 23:16:17.219502 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: User-Agent: python-urllib3/1.26.10 Jul 25 23:16:17.219502 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Auth-Token: gAAAAABi3yMnWBF6N7ojia5nXsORomJKEubbLBv0vxCjlfVfsMo4Tn2EFSjvpY4M7xgoUAXGyz8xdNhwjA2Y6j5eYhzQSRo3SbffFPsEnm8ehR5gzh2aHTMOW72yy4L7WJZWPo5TX3ANcF5axUZPg2syZaiRay85nhAKbscEZHRDYy-zr1KSX8Y Jul 25 23:16:17.219502 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Id: None Jul 25 23:16:17.219502 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Name: None Jul 25 23:16:17.219502 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Identity-Status: Confirmed Jul 25 23:16:17.219502 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Is-Admin-Project: True Jul 25 23:16:17.219502 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Id: default Jul 25 23:16:17.219502 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Name: Default Jul 25 23:16:17.219502 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Id: bca196a6befb4fae9531dc96a1e58d5f Jul 25 23:16:17.219502 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Name: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:16:17.219502 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Role: reader,member Jul 25 23:16:17.219502 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Roles: reader,member Jul 25 23:16:17.221143 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_bca196a6befb4fae9531dc96a1e58d5f", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:16:17.221143 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:16:17.221143 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Id: bca196a6befb4fae9531dc96a1e58d5f Jul 25 23:16:17.221143 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:16:17.221143 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User: tempest-AttachVolumeNegativeTest-920481926-project Jul 25 23:16:17.221143 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Id: default Jul 25 23:16:17.221143 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Name: Default Jul 25 23:16:17.221143 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Id: f54ad4a554de414a80ed03d62c1eb3a5 Jul 25 23:16:17.221143 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Name: tempest-AttachVolumeNegativeTest-920481926-project Jul 25 23:16:17.221143 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: method: > Jul 25 23:16:17.221143 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: exception: Instance 6da72d7b-eb7f-4135-97e0-49f603ac903d could not be found. Jul 25 23:16:17.221143 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: action_args: {'id': '6da72d7b-eb7f-4135-97e0-49f603ac903d'} Jul 25 23:16:17.222094 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:16:17.222094 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:16:17.222094 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:16:17.222094 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:16:17.222094 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:16:17.222094 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:16:17.222094 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:16:17.222094 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:16:17.222094 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:16:17.222094 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:16:17.222094 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6da72d7b-eb7f-4135-97e0-49f603ac903d could not be found. Jul 25 23:16:17.222094 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:16:17.222094 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:16:17.222094 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:16:17.222094 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:16:17.222094 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:16:17.222094 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:16:17.222094 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:16:17.222094 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:16:17.222094 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:16:17.223645 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:16:17.223645 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 23:16:17.223645 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 23:16:17.223645 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:16:17.223645 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:16:17.223645 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:16:17.223645 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:16:17.223645 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6da72d7b-eb7f-4135-97e0-49f603ac903d could not be found. Jul 25 23:16:17.223645 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:16:17.223645 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:16:17.223645 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:16:17.223645 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:16:17.223645 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:16:17.223645 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:16:17.223645 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:16:17.223645 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:16:17.223645 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6da72d7b-eb7f-4135-97e0-49f603ac903d could not be found. Jul 25 23:16:17.223645 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:16:17.225004 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-e9ea6950-5502-41d3-96a4-a3f3faa3b177 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Returning 404 to user: Instance 6da72d7b-eb7f-4135-97e0-49f603ac903d could not be found. {{(pid=118409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:16:17.225004 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-e9ea6950-5502-41d3-96a4-a3f3faa3b177 tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d" status: 404 len: 111 microversion: 2.1 time: 0.029778 Jul 25 23:16:17.225004 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 517/1037] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:16:17 2022] GET /compute/v2.1/servers/6da72d7b-eb7f-4135-97e0-49f603ac903d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 23:16:18.447680 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-20c86569-0054-4a38-98c2-d729f5d8bb0e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:16:18.448209 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-20c86569-0054-4a38-98c2-d729f5d8bb0e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:16:18.454994 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-20c86569-0054-4a38-98c2-d729f5d8bb0e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:18.455438 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-20c86569-0054-4a38-98c2-d729f5d8bb0e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:18.456231 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-20c86569-0054-4a38-98c2-d729f5d8bb0e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:18.456681 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-20c86569-0054-4a38-98c2-d729f5d8bb0e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:18.470129 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-20c86569-0054-4a38-98c2-d729f5d8bb0e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] HTTP exception thrown: Instance d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf could not be found. Jul 25 23:16:18.471693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-20c86569-0054-4a38-98c2-d729f5d8bb0e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Request method failure captured: Jul 25 23:16:18.471693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: request: DELETE /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf HTTP/1.1 Jul 25 23:16:18.471693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 25 23:16:18.471693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 25 23:16:18.471693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Connection: close Jul 25 23:16:18.471693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 25 23:16:18.471693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 25 23:16:18.471693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Host: 10.222.0.55 Jul 25 23:16:18.471693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 25 23:16:18.471693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.10 Jul 25 23:16:18.471693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABi3yMnWBF6N7ojia5nXsORomJKEubbLBv0vxCjlfVfsMo4Tn2EFSjvpY4M7xgoUAXGyz8xdNhwjA2Y6j5eYhzQSRo3SbffFPsEnm8ehR5gzh2aHTMOW72yy4L7WJZWPo5TX3ANcF5axUZPg2syZaiRay85nhAKbscEZHRDYy-zr1KSX8Y Jul 25 23:16:18.471693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 25 23:16:18.471693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 25 23:16:18.471693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 25 23:16:18.471693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 25 23:16:18.471693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 25 23:16:18.471693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 25 23:16:18.471693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Id: bca196a6befb4fae9531dc96a1e58d5f Jul 25 23:16:18.471693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:16:18.471693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Role: reader,member Jul 25 23:16:18.471693 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Roles: reader,member Jul 25 23:16:18.473304 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_bca196a6befb4fae9531dc96a1e58d5f", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:16:18.473304 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:16:18.473304 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Id: bca196a6befb4fae9531dc96a1e58d5f Jul 25 23:16:18.473304 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:16:18.473304 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User: tempest-AttachVolumeNegativeTest-920481926-project Jul 25 23:16:18.473304 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 25 23:16:18.473304 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 25 23:16:18.473304 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Id: f54ad4a554de414a80ed03d62c1eb3a5 Jul 25 23:16:18.473304 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-AttachVolumeNegativeTest-920481926-project Jul 25 23:16:18.473304 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: method: > Jul 25 23:16:18.473304 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: exception: Instance d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf could not be found. Jul 25 23:16:18.473304 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: action_args: {'id': 'd61a91a5-1d8c-4452-bb6f-de7ebd5d56bf'} Jul 25 23:16:18.474241 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:16:18.474241 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:16:18.474241 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:16:18.474241 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:16:18.474241 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:16:18.474241 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:16:18.474241 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:16:18.474241 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:16:18.474241 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:16:18.474241 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:16:18.474241 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf could not be found. Jul 25 23:16:18.474241 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:16:18.474241 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:16:18.474241 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:16:18.474241 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:16:18.474241 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:16:18.474241 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:16:18.474241 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:16:18.474241 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:16:18.474241 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:16:18.475452 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:16:18.475452 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 23:16:18.475452 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 23:16:18.475452 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 23:16:18.475452 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 23:16:18.475452 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:16:18.475452 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:16:18.475452 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:16:18.475452 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:16:18.475452 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf could not be found. Jul 25 23:16:18.475452 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:16:18.475452 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:16:18.475452 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:16:18.475452 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:16:18.475452 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:16:18.475452 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:16:18.475452 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:16:18.475452 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:16:18.475452 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf could not be found. Jul 25 23:16:18.475452 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:16:18.476664 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-20c86569-0054-4a38-98c2-d729f5d8bb0e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Returning 404 to user: Instance d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:16:18.476664 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-20c86569-0054-4a38-98c2-d729f5d8bb0e tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "DELETE /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf" status: 404 len: 111 microversion: 2.1 time: 0.029373 Jul 25 23:16:18.476664 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 521/1038] 10.222.0.55 () {58 vars in 1239 bytes} [Mon Jul 25 23:16:18 2022] DELETE /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:16:18.482005 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-7281db81-f312-4ea9-b371-dc44cf2cd3be tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:16:18.482618 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-7281db81-f312-4ea9-b371-dc44cf2cd3be tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] [instance: d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:16:18.489085 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7281db81-f312-4ea9-b371-dc44cf2cd3be tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:18.489564 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7281db81-f312-4ea9-b371-dc44cf2cd3be tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:18.490332 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7281db81-f312-4ea9-b371-dc44cf2cd3be tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:18.490771 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7281db81-f312-4ea9-b371-dc44cf2cd3be tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:18.505905 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.wsgi [None req-7281db81-f312-4ea9-b371-dc44cf2cd3be tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] HTTP exception thrown: Instance d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf could not be found. Jul 25 23:16:18.507453 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-7281db81-f312-4ea9-b371-dc44cf2cd3be tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Request method failure captured: Jul 25 23:16:18.507453 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: request: GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf HTTP/1.1 Jul 25 23:16:18.507453 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept: application/json Jul 25 23:16:18.507453 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept-Encoding: identity Jul 25 23:16:18.507453 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Connection: close Jul 25 23:16:18.507453 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Length: 0 Jul 25 23:16:18.507453 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Type: application/json Jul 25 23:16:18.507453 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Host: 10.222.0.55 Jul 25 23:16:18.507453 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Openstack-System-Scope: None Jul 25 23:16:18.507453 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: User-Agent: python-urllib3/1.26.10 Jul 25 23:16:18.507453 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Auth-Token: gAAAAABi3yMnWBF6N7ojia5nXsORomJKEubbLBv0vxCjlfVfsMo4Tn2EFSjvpY4M7xgoUAXGyz8xdNhwjA2Y6j5eYhzQSRo3SbffFPsEnm8ehR5gzh2aHTMOW72yy4L7WJZWPo5TX3ANcF5axUZPg2syZaiRay85nhAKbscEZHRDYy-zr1KSX8Y Jul 25 23:16:18.507453 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Id: None Jul 25 23:16:18.507453 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Name: None Jul 25 23:16:18.507453 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Identity-Status: Confirmed Jul 25 23:16:18.507453 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Is-Admin-Project: True Jul 25 23:16:18.507453 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Id: default Jul 25 23:16:18.507453 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Name: Default Jul 25 23:16:18.507453 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Id: bca196a6befb4fae9531dc96a1e58d5f Jul 25 23:16:18.507453 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Name: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:16:18.507453 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Role: reader,member Jul 25 23:16:18.507453 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Roles: reader,member Jul 25 23:16:18.509143 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_bca196a6befb4fae9531dc96a1e58d5f", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/bca196a6befb4fae9531dc96a1e58d5f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:16:18.509143 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:16:18.509143 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Id: bca196a6befb4fae9531dc96a1e58d5f Jul 25 23:16:18.509143 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-920481926 Jul 25 23:16:18.509143 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User: tempest-AttachVolumeNegativeTest-920481926-project Jul 25 23:16:18.509143 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Id: default Jul 25 23:16:18.509143 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Name: Default Jul 25 23:16:18.509143 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Id: f54ad4a554de414a80ed03d62c1eb3a5 Jul 25 23:16:18.509143 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Name: tempest-AttachVolumeNegativeTest-920481926-project Jul 25 23:16:18.509143 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: method: > Jul 25 23:16:18.509143 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: exception: Instance d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf could not be found. Jul 25 23:16:18.509143 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: action_args: {'id': 'd61a91a5-1d8c-4452-bb6f-de7ebd5d56bf'} Jul 25 23:16:18.511068 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:16:18.511068 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:16:18.511068 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:16:18.511068 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:16:18.511068 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:16:18.511068 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:16:18.511068 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:16:18.511068 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:16:18.511068 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:16:18.511068 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:16:18.511068 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf could not be found. Jul 25 23:16:18.511068 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:16:18.511068 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:16:18.511068 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:16:18.511068 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:16:18.511068 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:16:18.511068 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:16:18.511068 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:16:18.511068 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:16:18.511068 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:16:18.512512 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:16:18.512512 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 23:16:18.512512 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 23:16:18.512512 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:16:18.512512 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:16:18.512512 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:16:18.512512 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:16:18.512512 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf could not be found. Jul 25 23:16:18.512512 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:16:18.512512 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:16:18.512512 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:16:18.512512 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:16:18.512512 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:16:18.512512 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:16:18.512512 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:16:18.512512 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:16:18.512512 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf could not be found. Jul 25 23:16:18.512512 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:16:18.514111 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-7281db81-f312-4ea9-b371-dc44cf2cd3be tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] Returning 404 to user: Instance d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf could not be found. {{(pid=118409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:16:18.514111 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-7281db81-f312-4ea9-b371-dc44cf2cd3be tempest-AttachVolumeNegativeTest-920481926 tempest-AttachVolumeNegativeTest-920481926-project] 10.222.0.55 "GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf" status: 404 len: 111 microversion: 2.1 time: 0.031287 Jul 25 23:16:18.514111 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 518/1039] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:16:18 2022] GET /compute/v2.1/servers/d61a91a5-1d8c-4452-bb6f-de7ebd5d56bf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:16:55.915150 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-abd95bcf-cde6-4549-b189-1310d48d2865 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:16:55.915780 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-abd95bcf-cde6-4549-b189-1310d48d2865 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: f900a476-26ad-48ba-95f9-eb96fa8b9dbe] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:16:55.919411 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:16:55.920094 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:16:55.923618 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-abd95bcf-cde6-4549-b189-1310d48d2865 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:55.926874 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-abd95bcf-cde6-4549-b189-1310d48d2865 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:55.926874 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-abd95bcf-cde6-4549-b189-1310d48d2865 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:55.926874 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-abd95bcf-cde6-4549-b189-1310d48d2865 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:55.953870 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-abd95bcf-cde6-4549-b189-1310d48d2865 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: f900a476-26ad-48ba-95f9-eb96fa8b9dbe] Going to try to terminate instance {{(pid=118410) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 23:16:56.281778 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-abd95bcf-cde6-4549-b189-1310d48d2865 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "DELETE /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe" status: 204 len: 0 microversion: 2.1 time: 0.370407 Jul 25 23:16:56.282373 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 522/1040] 10.222.0.55 () {58 vars in 1239 bytes} [Mon Jul 25 23:16:55 2022] DELETE /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 23:16:56.290466 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-90169379-046f-4971-a800-5e2713f7c4d3 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:16:56.291059 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-90169379-046f-4971-a800-5e2713f7c4d3 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: f900a476-26ad-48ba-95f9-eb96fa8b9dbe] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:16:56.295280 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:16:56.295904 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:16:56.299507 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-90169379-046f-4971-a800-5e2713f7c4d3 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:56.300161 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-90169379-046f-4971-a800-5e2713f7c4d3 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:56.300935 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-90169379-046f-4971-a800-5e2713f7c4d3 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:56.301450 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-90169379-046f-4971-a800-5e2713f7c4d3 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:56.436359 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-90169379-046f-4971-a800-5e2713f7c4d3 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:16:56.443913 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-90169379-046f-4971-a800-5e2713f7c4d3 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe" status: 200 len: 1577 microversion: 2.1 time: 0.157407 Jul 25 23:16:56.444482 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 519/1041] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:16:56 2022] GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:16:57.466082 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e76018ef-6044-456f-bbd3-b2dda622c23d tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:16:57.466993 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e76018ef-6044-456f-bbd3-b2dda622c23d tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: f900a476-26ad-48ba-95f9-eb96fa8b9dbe] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:16:57.474775 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e76018ef-6044-456f-bbd3-b2dda622c23d tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:57.475213 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e76018ef-6044-456f-bbd3-b2dda622c23d tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:57.475978 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e76018ef-6044-456f-bbd3-b2dda622c23d tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:57.476403 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e76018ef-6044-456f-bbd3-b2dda622c23d tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:57.625925 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e76018ef-6044-456f-bbd3-b2dda622c23d tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:16:57.633949 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e76018ef-6044-456f-bbd3-b2dda622c23d tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe" status: 200 len: 1577 microversion: 2.1 time: 0.172050 Jul 25 23:16:57.634535 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 523/1042] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:16:57 2022] GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:16:58.657533 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-6b67e9e0-1610-47a1-bc4a-43ba7cb55761 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:16:58.658167 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-6b67e9e0-1610-47a1-bc4a-43ba7cb55761 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: f900a476-26ad-48ba-95f9-eb96fa8b9dbe] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:16:58.664819 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6b67e9e0-1610-47a1-bc4a-43ba7cb55761 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:58.665291 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6b67e9e0-1610-47a1-bc4a-43ba7cb55761 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:58.666267 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6b67e9e0-1610-47a1-bc4a-43ba7cb55761 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:58.666695 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6b67e9e0-1610-47a1-bc4a-43ba7cb55761 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:58.737013 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-6b67e9e0-1610-47a1-bc4a-43ba7cb55761 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:16:58.744439 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-6b67e9e0-1610-47a1-bc4a-43ba7cb55761 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe" status: 200 len: 1510 microversion: 2.1 time: 0.092327 Jul 25 23:16:58.745002 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 520/1043] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:16:58 2022] GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe => generated 1510 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:16:59.082973 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-96740495-09b6-433e-9e4c-0ee5ba1d09ba req-1ed90c7d-39c9-4b28-a2ca-6cb23200eaae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f900a476-26ad-48ba-95f9-eb96fa8b9dbe", "name": "network-vif-deleted", "tag": "15c82377-73db-4e12-a607-be4262be29e4"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:16:59.097843 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-96740495-09b6-433e-9e4c-0ee5ba1d09ba req-1ed90c7d-39c9-4b28-a2ca-6cb23200eaae service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:59.098984 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-96740495-09b6-433e-9e4c-0ee5ba1d09ba req-1ed90c7d-39c9-4b28-a2ca-6cb23200eaae service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:59.136287 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-96740495-09b6-433e-9e4c-0ee5ba1d09ba req-1ed90c7d-39c9-4b28-a2ca-6cb23200eaae service nova] Creating event network-vif-deleted:15c82377-73db-4e12-a607-be4262be29e4 for instance f900a476-26ad-48ba-95f9-eb96fa8b9dbe on hv-cinder-79760 Jul 25 23:16:59.142233 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-96740495-09b6-433e-9e4c-0ee5ba1d09ba req-1ed90c7d-39c9-4b28-a2ca-6cb23200eaae service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222375 Jul 25 23:16:59.143202 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 524/1044] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:16:59.767651 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-9b60bc26-d45a-4611-a911-8093006568be tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:16:59.768256 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-9b60bc26-d45a-4611-a911-8093006568be tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: f900a476-26ad-48ba-95f9-eb96fa8b9dbe] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:16:59.775154 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9b60bc26-d45a-4611-a911-8093006568be tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:59.775606 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9b60bc26-d45a-4611-a911-8093006568be tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:59.776373 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9b60bc26-d45a-4611-a911-8093006568be tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:59.776812 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9b60bc26-d45a-4611-a911-8093006568be tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:59.812184 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9b60bc26-d45a-4611-a911-8093006568be tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:16:59.812622 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9b60bc26-d45a-4611-a911-8093006568be tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:16:59.813701 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.objects.instance [None req-9b60bc26-d45a-4611-a911-8093006568be tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lazy-loading 'fault' on Instance uuid f900a476-26ad-48ba-95f9-eb96fa8b9dbe {{(pid=118409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 23:16:59.886044 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-9b60bc26-d45a-4611-a911-8093006568be tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:16:59.894199 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-9b60bc26-d45a-4611-a911-8093006568be tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe" status: 200 len: 1230 microversion: 2.1 time: 0.131114 Jul 25 23:16:59.897267 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 521/1045] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:16:59 2022] GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe => generated 1230 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:17:00.916881 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-cd6bbb5a-78af-414a-86b7-7eb70769bfba tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:17:00.917606 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-cd6bbb5a-78af-414a-86b7-7eb70769bfba tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: f900a476-26ad-48ba-95f9-eb96fa8b9dbe] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:17:00.925460 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cd6bbb5a-78af-414a-86b7-7eb70769bfba tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:00.925907 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cd6bbb5a-78af-414a-86b7-7eb70769bfba tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:00.926686 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cd6bbb5a-78af-414a-86b7-7eb70769bfba tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:00.927122 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cd6bbb5a-78af-414a-86b7-7eb70769bfba tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:00.942047 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-cd6bbb5a-78af-414a-86b7-7eb70769bfba tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] HTTP exception thrown: Instance f900a476-26ad-48ba-95f9-eb96fa8b9dbe could not be found. Jul 25 23:17:00.943785 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-cd6bbb5a-78af-414a-86b7-7eb70769bfba tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Request method failure captured: Jul 25 23:17:00.943785 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe HTTP/1.1 Jul 25 23:17:00.943785 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 25 23:17:00.943785 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 25 23:17:00.943785 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Connection: close Jul 25 23:17:00.943785 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 25 23:17:00.943785 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 25 23:17:00.943785 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Host: 10.222.0.55 Jul 25 23:17:00.943785 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 25 23:17:00.943785 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.10 Jul 25 23:17:00.943785 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABi3yPG_u6_VIlihooKP8ZYQokhoS8GVUA0c86aUw25vcv8StYqyh7P0MN5QPq8YHO5d5GVLyacWhqkguKxp-vluVaTPxynyU_BQw2_CDzcgH5Mz4DtdjfsldpGIwM8M2pES1x7Wekfa5dHqLyZ_m7TKxxDAFFrGTrh5_B42jrppfOaWCU Jul 25 23:17:00.943785 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 25 23:17:00.943785 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 25 23:17:00.943785 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 25 23:17:00.943785 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 25 23:17:00.943785 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 25 23:17:00.943785 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 25 23:17:00.943785 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Id: f661a74731894c6e94eced8d8f7520e7 Jul 25 23:17:00.943785 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-TestVolumeBootPattern-1273322900 Jul 25 23:17:00.943785 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Role: reader,member Jul 25 23:17:00.943785 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Roles: reader,member Jul 25 23:17:00.948504 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f661a74731894c6e94eced8d8f7520e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f661a74731894c6e94eced8d8f7520e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f661a74731894c6e94eced8d8f7520e7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f661a74731894c6e94eced8d8f7520e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:17:00.948504 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-TestVolumeBootPattern-1273322900 Jul 25 23:17:00.948504 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Id: f661a74731894c6e94eced8d8f7520e7 Jul 25 23:17:00.948504 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-TestVolumeBootPattern-1273322900 Jul 25 23:17:00.948504 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User: tempest-TestVolumeBootPattern-1273322900-project Jul 25 23:17:00.948504 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 25 23:17:00.948504 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 25 23:17:00.948504 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Id: c862a035745641b5a8dde92a3d570b35 Jul 25 23:17:00.948504 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-TestVolumeBootPattern-1273322900-project Jul 25 23:17:00.948504 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: method: > Jul 25 23:17:00.948504 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: exception: Instance f900a476-26ad-48ba-95f9-eb96fa8b9dbe could not be found. Jul 25 23:17:00.948504 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: action_args: {'id': 'f900a476-26ad-48ba-95f9-eb96fa8b9dbe'} Jul 25 23:17:00.949361 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:17:00.949361 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:17:00.949361 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:17:00.949361 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:17:00.949361 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:17:00.949361 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:17:00.949361 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:17:00.949361 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:17:00.949361 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:17:00.949361 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:17:00.949361 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f900a476-26ad-48ba-95f9-eb96fa8b9dbe could not be found. Jul 25 23:17:00.949361 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:17:00.949361 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:17:00.949361 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:17:00.949361 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:17:00.949361 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:17:00.949361 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:17:00.949361 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:17:00.949361 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:17:00.949361 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:17:00.950715 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:17:00.950715 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 23:17:00.950715 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 23:17:00.950715 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:17:00.950715 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:17:00.950715 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:17:00.950715 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:17:00.950715 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f900a476-26ad-48ba-95f9-eb96fa8b9dbe could not be found. Jul 25 23:17:00.950715 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:17:00.950715 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:17:00.950715 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:17:00.950715 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:17:00.950715 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:17:00.950715 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:17:00.950715 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:17:00.950715 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:17:00.950715 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f900a476-26ad-48ba-95f9-eb96fa8b9dbe could not be found. Jul 25 23:17:00.950715 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:17:00.952555 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-cd6bbb5a-78af-414a-86b7-7eb70769bfba tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Returning 404 to user: Instance f900a476-26ad-48ba-95f9-eb96fa8b9dbe could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:17:00.952555 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-cd6bbb5a-78af-414a-86b7-7eb70769bfba tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe" status: 404 len: 111 microversion: 2.1 time: 0.032951 Jul 25 23:17:00.952555 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 525/1046] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:17:00 2022] GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:17:01.050776 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-6e91f0ae-0c0b-4c32-9e9f-9cf5ba4d2b8b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-498731065", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1194749679", "security_groups": [{"name": "tempest-secgroup-smoke-488560059"}], "block_device_mapping_v2": [{"uuid": "c98c14d5-6e34-4fa3-b45b-545cb0d9d4d3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ccff6ef8-9de0-43b7-8ccb-43439046b3f0"}]}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:17:01.165820 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.network.neutron [None req-6e91f0ae-0c0b-4c32-9e9f-9cf5ba4d2b8b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] validate_networks() for [('ccff6ef8-9de0-43b7-8ccb-43439046b3f0', None, None, None, None, None)] {{(pid=118409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 23:17:01.708647 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-6e91f0ae-0c0b-4c32-9e9f-9cf5ba4d2b8b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Flavor limits 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 23:17:01.709081 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-6e91f0ae-0c0b-4c32-9e9f-9cf5ba4d2b8b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Image limits 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 23:17:01.709592 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-6e91f0ae-0c0b-4c32-9e9f-9cf5ba4d2b8b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Flavor pref 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 23:17:01.710025 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-6e91f0ae-0c0b-4c32-9e9f-9cf5ba4d2b8b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Image pref 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 23:17:01.710432 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-6e91f0ae-0c0b-4c32-9e9f-9cf5ba4d2b8b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 23:17:01.719332 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6e91f0ae-0c0b-4c32-9e9f-9cf5ba4d2b8b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:01.720826 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6e91f0ae-0c0b-4c32-9e9f-9cf5ba4d2b8b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:01.720826 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6e91f0ae-0c0b-4c32-9e9f-9cf5ba4d2b8b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:01.721091 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6e91f0ae-0c0b-4c32-9e9f-9cf5ba4d2b8b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:01.737510 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-6e91f0ae-0c0b-4c32-9e9f-9cf5ba4d2b8b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Getting quotas for project f661a74731894c6e94eced8d8f7520e7. Resources: {'instances', 'cores', 'ram'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 23:17:01.741449 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-6e91f0ae-0c0b-4c32-9e9f-9cf5ba4d2b8b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Getting quotas for user c862a035745641b5a8dde92a3d570b35 and project f661a74731894c6e94eced8d8f7520e7. Resources: {'instances', 'cores', 'ram'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 23:17:01.800849 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-6e91f0ae-0c0b-4c32-9e9f-9cf5ba4d2b8b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Going to run 1 instances... {{(pid=118409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 23:17:01.803007 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-6e91f0ae-0c0b-4c32-9e9f-9cf5ba4d2b8b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: c2d4d668-a1e5-4c5c-9135-567e0a05bfe0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c98c14d5-6e34-4fa3-b45b-545cb0d9d4d3',volume_size=None,volume_type=None)] {{(pid=118409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 23:17:02.267988 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-6e91f0ae-0c0b-4c32-9e9f-9cf5ba4d2b8b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.220964 Jul 25 23:17:02.269004 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 522/1047] 10.222.0.55 () {60 vars in 1147 bytes} [Mon Jul 25 23:17:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 1224 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 23:17:02.284267 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-9a01a14f-8a19-4d86-bfe7-84abad5b1487 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:17:02.286148 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-9a01a14f-8a19-4d86-bfe7-84abad5b1487 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: c2d4d668-a1e5-4c5c-9135-567e0a05bfe0] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:17:02.358510 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9a01a14f-8a19-4d86-bfe7-84abad5b1487 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:17:02.366329 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-9a01a14f-8a19-4d86-bfe7-84abad5b1487 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0" status: 200 len: 1094 microversion: 2.1 time: 0.089993 Jul 25 23:17:02.366902 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 526/1048] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:17:02 2022] GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 => generated 1094 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:17:03.386898 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-6cdf1ab7-53fb-4328-b083-021aa0cd563b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:17:03.387543 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-6cdf1ab7-53fb-4328-b083-021aa0cd563b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: c2d4d668-a1e5-4c5c-9135-567e0a05bfe0] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:17:03.395468 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6cdf1ab7-53fb-4328-b083-021aa0cd563b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:03.395920 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6cdf1ab7-53fb-4328-b083-021aa0cd563b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:03.396694 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6cdf1ab7-53fb-4328-b083-021aa0cd563b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:03.397155 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6cdf1ab7-53fb-4328-b083-021aa0cd563b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:03.460569 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-6cdf1ab7-53fb-4328-b083-021aa0cd563b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:17:03.468752 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-6cdf1ab7-53fb-4328-b083-021aa0cd563b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0" status: 200 len: 1144 microversion: 2.1 time: 0.085850 Jul 25 23:17:03.469361 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 523/1049] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:17:03 2022] GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:17:04.491062 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5de12a61-5e7b-4851-8a59-314c56e390eb tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:17:04.491658 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-5de12a61-5e7b-4851-8a59-314c56e390eb tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: c2d4d668-a1e5-4c5c-9135-567e0a05bfe0] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:17:04.499894 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5de12a61-5e7b-4851-8a59-314c56e390eb tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:04.500334 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5de12a61-5e7b-4851-8a59-314c56e390eb tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:04.501105 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5de12a61-5e7b-4851-8a59-314c56e390eb tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:04.501572 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5de12a61-5e7b-4851-8a59-314c56e390eb tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:04.597513 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-5de12a61-5e7b-4851-8a59-314c56e390eb tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:17:04.605175 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-5de12a61-5e7b-4851-8a59-314c56e390eb tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0" status: 200 len: 1200 microversion: 2.1 time: 0.118067 Jul 25 23:17:04.605753 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 527/1050] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:17:04 2022] GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 => generated 1200 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:17:05.626795 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-a4276289-f1a3-40ec-b8f7-11caa2426000 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:17:05.627622 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-a4276289-f1a3-40ec-b8f7-11caa2426000 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: c2d4d668-a1e5-4c5c-9135-567e0a05bfe0] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:17:05.634282 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a4276289-f1a3-40ec-b8f7-11caa2426000 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:05.634874 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a4276289-f1a3-40ec-b8f7-11caa2426000 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:05.635764 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a4276289-f1a3-40ec-b8f7-11caa2426000 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:05.636333 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a4276289-f1a3-40ec-b8f7-11caa2426000 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:06.145811 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-a4276289-f1a3-40ec-b8f7-11caa2426000 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:17:06.153366 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-a4276289-f1a3-40ec-b8f7-11caa2426000 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0" status: 200 len: 1277 microversion: 2.1 time: 0.530700 Jul 25 23:17:06.153939 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 524/1051] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:17:05 2022] GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 => generated 1277 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:17:06.752258 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-e28bceeb-ecd1-4c35-b901-5291f9e0ad6b req-db0c41e0-fabd-4d5b-853b-b8ea8f35d201 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2d4d668-a1e5-4c5c-9135-567e0a05bfe0", "tag": "aecda5bb-f585-4d61-a56d-4134bf0e379b"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:17:06.768359 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-e28bceeb-ecd1-4c35-b901-5291f9e0ad6b req-db0c41e0-fabd-4d5b-853b-b8ea8f35d201 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:06.768933 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-e28bceeb-ecd1-4c35-b901-5291f9e0ad6b req-db0c41e0-fabd-4d5b-853b-b8ea8f35d201 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:06.780983 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-e28bceeb-ecd1-4c35-b901-5291f9e0ad6b req-db0c41e0-fabd-4d5b-853b-b8ea8f35d201 service nova] Creating event network-changed:aecda5bb-f585-4d61-a56d-4134bf0e379b for instance c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 on hv-cinder-79760 Jul 25 23:17:06.786520 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-e28bceeb-ecd1-4c35-b901-5291f9e0ad6b req-db0c41e0-fabd-4d5b-853b-b8ea8f35d201 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038383 Jul 25 23:17:06.787119 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 528/1052] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:17:07.176244 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-a2cca415-6329-451d-b50c-304663243802 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:17:07.176984 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-a2cca415-6329-451d-b50c-304663243802 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: c2d4d668-a1e5-4c5c-9135-567e0a05bfe0] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:17:07.183847 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a2cca415-6329-451d-b50c-304663243802 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:07.184293 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a2cca415-6329-451d-b50c-304663243802 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:07.185049 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a2cca415-6329-451d-b50c-304663243802 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:07.186175 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a2cca415-6329-451d-b50c-304663243802 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:07.323558 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-a2cca415-6329-451d-b50c-304663243802 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:17:07.331597 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-a2cca415-6329-451d-b50c-304663243802 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0" status: 200 len: 1265 microversion: 2.1 time: 0.159201 Jul 25 23:17:07.332166 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 525/1053] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:17:07 2022] GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:17:08.354125 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-dcfd864d-2969-4015-82a8-5794de286969 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:17:08.354826 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-dcfd864d-2969-4015-82a8-5794de286969 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: c2d4d668-a1e5-4c5c-9135-567e0a05bfe0] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:17:08.361262 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dcfd864d-2969-4015-82a8-5794de286969 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:08.361708 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dcfd864d-2969-4015-82a8-5794de286969 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:08.362504 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dcfd864d-2969-4015-82a8-5794de286969 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:08.362938 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-dcfd864d-2969-4015-82a8-5794de286969 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:08.494421 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-dcfd864d-2969-4015-82a8-5794de286969 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:17:08.502472 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-dcfd864d-2969-4015-82a8-5794de286969 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0" status: 200 len: 1265 microversion: 2.1 time: 0.153039 Jul 25 23:17:08.503033 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 529/1054] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:17:08 2022] GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:17:09.524027 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-59740442-8d99-4a2a-992a-17db81e80823 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:17:09.524672 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-59740442-8d99-4a2a-992a-17db81e80823 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: c2d4d668-a1e5-4c5c-9135-567e0a05bfe0] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:17:09.532016 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-59740442-8d99-4a2a-992a-17db81e80823 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:09.532456 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-59740442-8d99-4a2a-992a-17db81e80823 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:09.533256 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-59740442-8d99-4a2a-992a-17db81e80823 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:09.533799 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-59740442-8d99-4a2a-992a-17db81e80823 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:09.677836 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-59740442-8d99-4a2a-992a-17db81e80823 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:17:09.686071 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-59740442-8d99-4a2a-992a-17db81e80823 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0" status: 200 len: 1265 microversion: 2.1 time: 0.165420 Jul 25 23:17:09.686646 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 526/1055] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:17:09 2022] GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:17:10.706741 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-97d640ef-ec0a-4f1a-9adc-5ccf3d08afbd tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:17:10.709615 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-97d640ef-ec0a-4f1a-9adc-5ccf3d08afbd tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: c2d4d668-a1e5-4c5c-9135-567e0a05bfe0] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:17:10.716141 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-97d640ef-ec0a-4f1a-9adc-5ccf3d08afbd tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:10.717286 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-97d640ef-ec0a-4f1a-9adc-5ccf3d08afbd tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:10.718277 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-97d640ef-ec0a-4f1a-9adc-5ccf3d08afbd tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:10.718639 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-97d640ef-ec0a-4f1a-9adc-5ccf3d08afbd tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:10.859440 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-97d640ef-ec0a-4f1a-9adc-5ccf3d08afbd tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:17:10.867179 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-97d640ef-ec0a-4f1a-9adc-5ccf3d08afbd tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0" status: 200 len: 1265 microversion: 2.1 time: 0.164396 Jul 25 23:17:10.867746 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 530/1056] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:17:10 2022] GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:17:11.887872 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-1fab0c49-bbdd-4baf-b575-1bf1117f1591 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:17:11.888876 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-1fab0c49-bbdd-4baf-b575-1bf1117f1591 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: c2d4d668-a1e5-4c5c-9135-567e0a05bfe0] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:17:11.891308 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell0:SELECT=2 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:17:11.891957 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell0:SELECT=6 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:17:11.896824 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1fab0c49-bbdd-4baf-b575-1bf1117f1591 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:11.897313 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1fab0c49-bbdd-4baf-b575-1bf1117f1591 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:11.898079 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1fab0c49-bbdd-4baf-b575-1bf1117f1591 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:11.898518 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1fab0c49-bbdd-4baf-b575-1bf1117f1591 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:12.045440 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-1fab0c49-bbdd-4baf-b575-1bf1117f1591 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:17:12.052966 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-1fab0c49-bbdd-4baf-b575-1bf1117f1591 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0" status: 200 len: 1265 microversion: 2.1 time: 0.168914 Jul 25 23:17:12.053579 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 527/1057] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:17:11 2022] GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:17:13.074315 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-48a320bf-b153-4cbb-94e2-dff2dca5b8bc tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:17:13.074925 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-48a320bf-b153-4cbb-94e2-dff2dca5b8bc tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: c2d4d668-a1e5-4c5c-9135-567e0a05bfe0] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:17:13.077618 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=2 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:17:13.082550 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-48a320bf-b153-4cbb-94e2-dff2dca5b8bc tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:13.083001 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-48a320bf-b153-4cbb-94e2-dff2dca5b8bc tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:13.083779 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-48a320bf-b153-4cbb-94e2-dff2dca5b8bc tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:13.084216 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-48a320bf-b153-4cbb-94e2-dff2dca5b8bc tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:13.225935 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-48a320bf-b153-4cbb-94e2-dff2dca5b8bc tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:17:13.234210 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-48a320bf-b153-4cbb-94e2-dff2dca5b8bc tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0" status: 200 len: 1265 microversion: 2.1 time: 0.163702 Jul 25 23:17:13.234793 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 531/1058] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:17:13 2022] GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:17:14.254982 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-94060da9-5750-4f88-b8d4-2bec5f8683e3 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:17:14.255627 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-94060da9-5750-4f88-b8d4-2bec5f8683e3 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: c2d4d668-a1e5-4c5c-9135-567e0a05bfe0] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:17:14.262603 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-94060da9-5750-4f88-b8d4-2bec5f8683e3 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:14.263048 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-94060da9-5750-4f88-b8d4-2bec5f8683e3 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:14.265189 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-94060da9-5750-4f88-b8d4-2bec5f8683e3 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:14.265774 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-94060da9-5750-4f88-b8d4-2bec5f8683e3 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:14.428442 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-94060da9-5750-4f88-b8d4-2bec5f8683e3 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:17:14.436755 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-94060da9-5750-4f88-b8d4-2bec5f8683e3 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0" status: 200 len: 1265 microversion: 2.1 time: 0.185410 Jul 25 23:17:14.437568 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 528/1059] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:17:14 2022] GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:17:15.457599 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-caec6199-bec4-4d1b-8532-bfc4718f66d3 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:17:15.458256 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-caec6199-bec4-4d1b-8532-bfc4718f66d3 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: c2d4d668-a1e5-4c5c-9135-567e0a05bfe0] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:17:15.464950 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-caec6199-bec4-4d1b-8532-bfc4718f66d3 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:15.465433 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-caec6199-bec4-4d1b-8532-bfc4718f66d3 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:15.466263 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-caec6199-bec4-4d1b-8532-bfc4718f66d3 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:15.467466 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-caec6199-bec4-4d1b-8532-bfc4718f66d3 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:15.616268 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-caec6199-bec4-4d1b-8532-bfc4718f66d3 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:17:15.625254 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-caec6199-bec4-4d1b-8532-bfc4718f66d3 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0" status: 200 len: 1265 microversion: 2.1 time: 0.171475 Jul 25 23:17:15.625828 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 532/1060] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:17:15 2022] GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:17:16.646132 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-6b89bc82-d59a-40b1-8e85-7132a726f1d2 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:17:16.646687 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-6b89bc82-d59a-40b1-8e85-7132a726f1d2 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: c2d4d668-a1e5-4c5c-9135-567e0a05bfe0] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:17:16.653257 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6b89bc82-d59a-40b1-8e85-7132a726f1d2 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:16.653701 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6b89bc82-d59a-40b1-8e85-7132a726f1d2 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:16.656149 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6b89bc82-d59a-40b1-8e85-7132a726f1d2 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:16.656589 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6b89bc82-d59a-40b1-8e85-7132a726f1d2 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:16.798064 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-6b89bc82-d59a-40b1-8e85-7132a726f1d2 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:17:16.807426 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-6b89bc82-d59a-40b1-8e85-7132a726f1d2 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0" status: 200 len: 1265 microversion: 2.1 time: 0.165081 Jul 25 23:17:16.808393 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 529/1061] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:17:16 2022] GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:17:17.830284 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-43d0272e-2098-4eb6-bd02-9b2fffe34038 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:17:17.830838 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-43d0272e-2098-4eb6-bd02-9b2fffe34038 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: c2d4d668-a1e5-4c5c-9135-567e0a05bfe0] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:17:17.837932 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-43d0272e-2098-4eb6-bd02-9b2fffe34038 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:17.838381 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-43d0272e-2098-4eb6-bd02-9b2fffe34038 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:17.839156 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-43d0272e-2098-4eb6-bd02-9b2fffe34038 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:17.839594 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-43d0272e-2098-4eb6-bd02-9b2fffe34038 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:18.038200 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-43d0272e-2098-4eb6-bd02-9b2fffe34038 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:17:18.046885 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-43d0272e-2098-4eb6-bd02-9b2fffe34038 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0" status: 200 len: 1265 microversion: 2.1 time: 0.220833 Jul 25 23:17:18.047611 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 533/1062] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:17:17 2022] GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 => generated 1265 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:17:19.070922 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-67844606-149b-418c-80b7-391217ab1342 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:17:19.071687 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-67844606-149b-418c-80b7-391217ab1342 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: c2d4d668-a1e5-4c5c-9135-567e0a05bfe0] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:17:19.078292 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-67844606-149b-418c-80b7-391217ab1342 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:19.078826 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-67844606-149b-418c-80b7-391217ab1342 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:19.079514 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-67844606-149b-418c-80b7-391217ab1342 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:19.079951 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-67844606-149b-418c-80b7-391217ab1342 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:19.118346 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-7baf38d0-384f-4105-9779-65ecc7a69f04 req-8d3d8846-6898-4732-a7d2-4fc4b82e7c09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2d4d668-a1e5-4c5c-9135-567e0a05bfe0", "name": "network-vif-plugged", "status": "completed", "tag": "aecda5bb-f585-4d61-a56d-4134bf0e379b"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:17:19.137106 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-7baf38d0-384f-4105-9779-65ecc7a69f04 req-8d3d8846-6898-4732-a7d2-4fc4b82e7c09 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:19.137853 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-7baf38d0-384f-4105-9779-65ecc7a69f04 req-8d3d8846-6898-4732-a7d2-4fc4b82e7c09 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:19.152743 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-7baf38d0-384f-4105-9779-65ecc7a69f04 req-8d3d8846-6898-4732-a7d2-4fc4b82e7c09 service nova] Creating event network-vif-plugged:aecda5bb-f585-4d61-a56d-4134bf0e379b for instance c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 on hv-cinder-79760 Jul 25 23:17:19.159169 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-7baf38d0-384f-4105-9779-65ecc7a69f04 req-8d3d8846-6898-4732-a7d2-4fc4b82e7c09 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048977 Jul 25 23:17:19.160096 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 534/1063] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:17:19.308037 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-67844606-149b-418c-80b7-391217ab1342 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:17:19.317034 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-67844606-149b-418c-80b7-391217ab1342 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0" status: 200 len: 1265 microversion: 2.1 time: 0.249827 Jul 25 23:17:19.317672 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 530/1064] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:17:19 2022] GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 => generated 1265 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:17:20.340468 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-7aea68da-2a2d-48f2-8f87-27eb6285b749 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:17:20.341761 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-7aea68da-2a2d-48f2-8f87-27eb6285b749 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: c2d4d668-a1e5-4c5c-9135-567e0a05bfe0] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:17:20.350069 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7aea68da-2a2d-48f2-8f87-27eb6285b749 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:20.355443 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7aea68da-2a2d-48f2-8f87-27eb6285b749 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:20.355443 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7aea68da-2a2d-48f2-8f87-27eb6285b749 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:20.355443 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7aea68da-2a2d-48f2-8f87-27eb6285b749 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:20.504725 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7aea68da-2a2d-48f2-8f87-27eb6285b749 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:17:20.518928 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-7aea68da-2a2d-48f2-8f87-27eb6285b749 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0" status: 200 len: 1265 microversion: 2.1 time: 0.181361 Jul 25 23:17:20.524297 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 535/1065] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:17:20 2022] GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:17:21.549773 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-19b305dc-4102-4339-af2c-872ba918c4a5 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:17:21.550555 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-19b305dc-4102-4339-af2c-872ba918c4a5 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: c2d4d668-a1e5-4c5c-9135-567e0a05bfe0] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:17:21.557105 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-19b305dc-4102-4339-af2c-872ba918c4a5 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:21.557625 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-19b305dc-4102-4339-af2c-872ba918c4a5 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:21.558416 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-19b305dc-4102-4339-af2c-872ba918c4a5 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:21.558904 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-19b305dc-4102-4339-af2c-872ba918c4a5 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:21.744445 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-19b305dc-4102-4339-af2c-872ba918c4a5 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:17:21.760566 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-19b305dc-4102-4339-af2c-872ba918c4a5 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0" status: 200 len: 1452 microversion: 2.1 time: 0.217426 Jul 25 23:17:21.763268 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 531/1066] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:17:21 2022] GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 => generated 1452 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:17:21.785999 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-7d64f473-fa65-49ac-9fbd-3781c9b0975a tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:17:21.785999 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-7d64f473-fa65-49ac-9fbd-3781c9b0975a tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: c2d4d668-a1e5-4c5c-9135-567e0a05bfe0] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:17:21.794225 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7d64f473-fa65-49ac-9fbd-3781c9b0975a tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:21.797475 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7d64f473-fa65-49ac-9fbd-3781c9b0975a tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:21.797475 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7d64f473-fa65-49ac-9fbd-3781c9b0975a tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:21.797475 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-7d64f473-fa65-49ac-9fbd-3781c9b0975a tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:21.978672 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-7d64f473-fa65-49ac-9fbd-3781c9b0975a tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:17:21.988177 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-7d64f473-fa65-49ac-9fbd-3781c9b0975a tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0" status: 200 len: 1452 microversion: 2.1 time: 0.210212 Jul 25 23:17:21.988750 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 536/1067] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:17:21 2022] GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 => generated 1452 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:17:24.859403 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-5af8961a-4dc4-4b9d-97d8-27d814df793e req-35bda064-12d6-4f1e-a98e-61f0483b5595 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2d4d668-a1e5-4c5c-9135-567e0a05bfe0", "tag": "aecda5bb-f585-4d61-a56d-4134bf0e379b"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:17:24.869990 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-5af8961a-4dc4-4b9d-97d8-27d814df793e req-35bda064-12d6-4f1e-a98e-61f0483b5595 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:24.872031 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-5af8961a-4dc4-4b9d-97d8-27d814df793e req-35bda064-12d6-4f1e-a98e-61f0483b5595 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:24.883559 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-5af8961a-4dc4-4b9d-97d8-27d814df793e req-35bda064-12d6-4f1e-a98e-61f0483b5595 service nova] Creating event network-changed:aecda5bb-f585-4d61-a56d-4134bf0e379b for instance c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 on hv-cinder-79760 Jul 25 23:17:24.889605 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-5af8961a-4dc4-4b9d-97d8-27d814df793e req-35bda064-12d6-4f1e-a98e-61f0483b5595 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033326 Jul 25 23:17:24.890301 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 532/1068] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:17:29.378359 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 23:17:29.378900 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Mon Jul 25 23:17:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 23:17:30.314488 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-1d334306-2b7b-498b-b7b6-91c20d87c52f tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Action: 'create', calling method: .version_select at 0x7f622c078e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-1781200558", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFHlVw834ZHwjXkSQtL3XpaJsvSS3hmBxFPK4aYKZNCbwuhsZLta+shkR8t7JhQrEXbE/67LaMY32VbfK+xV8VOOWO1Nx5XcGlpzhhfeO5fYLIpNCwDichYda7CbM4kKg=="}} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:17:30.319794 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:17:30.330393 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-1d334306-2b7b-498b-b7b6-91c20d87c52f tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Getting quotas for project 249b4da896194c73b9ef659a254dea52. Resources: {'key_pairs'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 23:17:30.334178 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.quota [None req-1d334306-2b7b-498b-b7b6-91c20d87c52f tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Getting quotas for user e86e64a691c048e091ae6a23b5edf048 and project 249b4da896194c73b9ef659a254dea52. Resources: {'key_pairs'} {{(pid=118410) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 23:17:30.391528 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-1d334306-2b7b-498b-b7b6-91c20d87c52f tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.244741 Jul 25 23:17:30.392415 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 537/1069] 10.222.0.55 () {60 vars in 1159 bytes} [Mon Jul 25 23:17:30 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:17:50.508141 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:17:50.508141 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=78 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:17:50.510330 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-e7a34770-9b0c-4262-a6a0-305688302989 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1092642187", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1781200558", "security_groups": [{"name": "tempest-secgroup-smoke-1556952066"}], "networks": [{"uuid": "b705185f-a6fb-4813-94f8-0605fb04f0d3"}], "block_device_mapping_v2": [{"uuid": "7f5d2808-279c-4cc7-b8e6-4849d2ec52ae", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:17:50.625320 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.network.neutron [None req-e7a34770-9b0c-4262-a6a0-305688302989 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] validate_networks() for [('b705185f-a6fb-4813-94f8-0605fb04f0d3', None, None, None, None, None)] {{(pid=118409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 23:17:51.008257 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-e7a34770-9b0c-4262-a6a0-305688302989 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Flavor limits 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 23:17:51.008684 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-e7a34770-9b0c-4262-a6a0-305688302989 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Image limits 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 23:17:51.009230 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-e7a34770-9b0c-4262-a6a0-305688302989 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Flavor pref 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 23:17:51.009642 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-e7a34770-9b0c-4262-a6a0-305688302989 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Image pref 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 23:17:51.010053 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-e7a34770-9b0c-4262-a6a0-305688302989 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 23:17:51.020082 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e7a34770-9b0c-4262-a6a0-305688302989 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:51.020530 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e7a34770-9b0c-4262-a6a0-305688302989 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:51.021364 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e7a34770-9b0c-4262-a6a0-305688302989 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:51.021805 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e7a34770-9b0c-4262-a6a0-305688302989 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:51.039771 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-e7a34770-9b0c-4262-a6a0-305688302989 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Getting quotas for project 249b4da896194c73b9ef659a254dea52. Resources: {'instances', 'cores', 'ram'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 23:17:51.043785 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-e7a34770-9b0c-4262-a6a0-305688302989 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Getting quotas for user e86e64a691c048e091ae6a23b5edf048 and project 249b4da896194c73b9ef659a254dea52. Resources: {'instances', 'cores', 'ram'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 23:17:51.103902 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-e7a34770-9b0c-4262-a6a0-305688302989 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Going to run 1 instances... {{(pid=118409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 23:17:51.106118 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-e7a34770-9b0c-4262-a6a0-305688302989 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7f5d2808-279c-4cc7-b8e6-4849d2ec52ae',volume_size=None,volume_type=None)] {{(pid=118409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 23:17:51.575167 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-e7a34770-9b0c-4262-a6a0-305688302989 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.071265 Jul 25 23:17:51.575876 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 533/1070] 10.222.0.55 () {60 vars in 1147 bytes} [Mon Jul 25 23:17:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 1073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 25 23:17:51.584995 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:17:51.585845 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=4 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:17:51.589921 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-54580fa1-61cf-4572-8603-8fb9e850b603 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:17:51.590364 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-54580fa1-61cf-4572-8603-8fb9e850b603 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:17:51.645646 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-54580fa1-61cf-4572-8603-8fb9e850b603 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:17:51.652393 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-54580fa1-61cf-4572-8603-8fb9e850b603 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1089 microversion: 2.1 time: 0.068560 Jul 25 23:17:51.652963 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 538/1071] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:17:51 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1089 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:17:52.673326 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-40c671f7-fda4-4531-a4f1-ac8cd7132f57 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:17:52.674071 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-40c671f7-fda4-4531-a4f1-ac8cd7132f57 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:17:52.681384 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-40c671f7-fda4-4531-a4f1-ac8cd7132f57 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:52.681835 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-40c671f7-fda4-4531-a4f1-ac8cd7132f57 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:52.682607 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-40c671f7-fda4-4531-a4f1-ac8cd7132f57 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:52.683039 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-40c671f7-fda4-4531-a4f1-ac8cd7132f57 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:52.751744 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-40c671f7-fda4-4531-a4f1-ac8cd7132f57 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:17:52.759918 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-40c671f7-fda4-4531-a4f1-ac8cd7132f57 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1139 microversion: 2.1 time: 0.090689 Jul 25 23:17:52.760801 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 534/1072] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:17:52 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1139 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:17:53.783090 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-cee4afe3-b7a5-4657-8dfe-1f222e082303 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:17:53.784149 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-cee4afe3-b7a5-4657-8dfe-1f222e082303 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:17:53.791525 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cee4afe3-b7a5-4657-8dfe-1f222e082303 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:53.794457 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cee4afe3-b7a5-4657-8dfe-1f222e082303 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:53.794457 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cee4afe3-b7a5-4657-8dfe-1f222e082303 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:53.794457 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-cee4afe3-b7a5-4657-8dfe-1f222e082303 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:53.857763 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-cee4afe3-b7a5-4657-8dfe-1f222e082303 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:17:53.866653 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-cee4afe3-b7a5-4657-8dfe-1f222e082303 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1187 microversion: 2.1 time: 0.087981 Jul 25 23:17:53.867221 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 539/1073] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:17:53 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1187 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:17:54.887430 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-13baaa7b-814b-4070-a537-5a4177311906 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:17:54.888312 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-13baaa7b-814b-4070-a537-5a4177311906 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:17:54.895609 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-13baaa7b-814b-4070-a537-5a4177311906 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:54.896058 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-13baaa7b-814b-4070-a537-5a4177311906 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:54.896825 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-13baaa7b-814b-4070-a537-5a4177311906 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:54.897283 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-13baaa7b-814b-4070-a537-5a4177311906 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:54.967212 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-13baaa7b-814b-4070-a537-5a4177311906 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:17:54.976012 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-13baaa7b-814b-4070-a537-5a4177311906 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1205 microversion: 2.1 time: 0.092378 Jul 25 23:17:54.976656 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 535/1074] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:17:54 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1205 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:17:55.999893 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c1d4b295-5400-4c08-979c-1f68e6f8e232 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:17:56.005352 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c1d4b295-5400-4c08-979c-1f68e6f8e232 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:17:56.007866 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c1d4b295-5400-4c08-979c-1f68e6f8e232 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:56.008314 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c1d4b295-5400-4c08-979c-1f68e6f8e232 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:56.009090 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c1d4b295-5400-4c08-979c-1f68e6f8e232 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:56.009607 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c1d4b295-5400-4c08-979c-1f68e6f8e232 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:56.167597 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-7f9ca5c1-938c-4b3b-bd5b-13e3d5c1836d req-60b128ef-4036-4fdc-92d7-6bacdd383731 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aef45a51-92a9-46be-8adf-5d7d259dbe28", "tag": "0ea01c9b-495f-4404-af19-caa8c31834e3"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:17:56.182620 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-7f9ca5c1-938c-4b3b-bd5b-13e3d5c1836d req-60b128ef-4036-4fdc-92d7-6bacdd383731 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:56.183375 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-7f9ca5c1-938c-4b3b-bd5b-13e3d5c1836d req-60b128ef-4036-4fdc-92d7-6bacdd383731 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:56.199265 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-7f9ca5c1-938c-4b3b-bd5b-13e3d5c1836d req-60b128ef-4036-4fdc-92d7-6bacdd383731 service nova] Creating event network-changed:0ea01c9b-495f-4404-af19-caa8c31834e3 for instance aef45a51-92a9-46be-8adf-5d7d259dbe28 on hv-cinder-79760 Jul 25 23:17:56.214353 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-7f9ca5c1-938c-4b3b-bd5b-13e3d5c1836d req-60b128ef-4036-4fdc-92d7-6bacdd383731 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046084 Jul 25 23:17:56.214353 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 536/1075] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:17:56.217001 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-c1d4b295-5400-4c08-979c-1f68e6f8e232 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:17:56.225715 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c1d4b295-5400-4c08-979c-1f68e6f8e232 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1273 microversion: 2.1 time: 0.230324 Jul 25 23:17:56.226298 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 540/1076] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:17:55 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1273 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:17:57.247806 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-eadddf91-be0e-4272-b331-a53537888b32 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:17:57.248485 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-eadddf91-be0e-4272-b331-a53537888b32 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:17:57.255773 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-eadddf91-be0e-4272-b331-a53537888b32 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:57.256225 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-eadddf91-be0e-4272-b331-a53537888b32 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:57.256991 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-eadddf91-be0e-4272-b331-a53537888b32 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:57.257455 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-eadddf91-be0e-4272-b331-a53537888b32 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:57.399812 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-eadddf91-be0e-4272-b331-a53537888b32 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:17:57.407644 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-eadddf91-be0e-4272-b331-a53537888b32 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1261 microversion: 2.1 time: 0.164443 Jul 25 23:17:57.408281 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 537/1077] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:17:57 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:17:58.432462 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-35958e62-8b4a-4d77-956a-0822fbc29a6f tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:17:58.433569 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-35958e62-8b4a-4d77-956a-0822fbc29a6f tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:17:58.440557 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-35958e62-8b4a-4d77-956a-0822fbc29a6f tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:58.441009 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-35958e62-8b4a-4d77-956a-0822fbc29a6f tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:58.441881 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-35958e62-8b4a-4d77-956a-0822fbc29a6f tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:58.442316 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-35958e62-8b4a-4d77-956a-0822fbc29a6f tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:58.581241 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-35958e62-8b4a-4d77-956a-0822fbc29a6f tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:17:58.588830 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-35958e62-8b4a-4d77-956a-0822fbc29a6f tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1261 microversion: 2.1 time: 0.162233 Jul 25 23:17:58.589434 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 541/1078] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:17:58 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:17:59.609957 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-08c7708c-0220-41ca-94d4-cb35bb2c8f6a tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:17:59.611581 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-08c7708c-0220-41ca-94d4-cb35bb2c8f6a tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:17:59.618145 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-08c7708c-0220-41ca-94d4-cb35bb2c8f6a tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:59.618587 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-08c7708c-0220-41ca-94d4-cb35bb2c8f6a tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:59.619345 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-08c7708c-0220-41ca-94d4-cb35bb2c8f6a tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:17:59.619769 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-08c7708c-0220-41ca-94d4-cb35bb2c8f6a tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:17:59.763854 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-08c7708c-0220-41ca-94d4-cb35bb2c8f6a tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:17:59.775129 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-08c7708c-0220-41ca-94d4-cb35bb2c8f6a tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1261 microversion: 2.1 time: 0.168818 Jul 25 23:17:59.776096 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 538/1079] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:17:59 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1261 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:18:00.803885 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e975ca27-ea7b-4738-abd8-7698190c72fb tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:18:00.804438 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e975ca27-ea7b-4738-abd8-7698190c72fb tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:18:00.811433 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e975ca27-ea7b-4738-abd8-7698190c72fb tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:18:00.811912 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e975ca27-ea7b-4738-abd8-7698190c72fb tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:18:00.812714 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e975ca27-ea7b-4738-abd8-7698190c72fb tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:18:00.813331 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e975ca27-ea7b-4738-abd8-7698190c72fb tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:18:00.948741 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e975ca27-ea7b-4738-abd8-7698190c72fb tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:18:00.956793 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e975ca27-ea7b-4738-abd8-7698190c72fb tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1261 microversion: 2.1 time: 0.157154 Jul 25 23:18:00.957392 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 542/1080] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:18:00 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:18:01.979303 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-9d024f58-459b-425b-8ee2-706e66a0013f tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:18:01.979904 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-9d024f58-459b-425b-8ee2-706e66a0013f tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:18:01.982549 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell0:SELECT=2 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:18:01.983313 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell0:SELECT=6 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:18:01.989256 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9d024f58-459b-425b-8ee2-706e66a0013f tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:18:01.989728 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9d024f58-459b-425b-8ee2-706e66a0013f tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:18:01.990540 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9d024f58-459b-425b-8ee2-706e66a0013f tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:18:01.990965 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9d024f58-459b-425b-8ee2-706e66a0013f tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:18:02.134168 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-9d024f58-459b-425b-8ee2-706e66a0013f tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:18:02.142701 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-9d024f58-459b-425b-8ee2-706e66a0013f tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1261 microversion: 2.1 time: 0.167133 Jul 25 23:18:02.143311 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 539/1081] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:18:01 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1261 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:18:03.164033 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4034a4e6-58c8-46a7-b1d5-7fbb5db7c33c tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:18:03.164634 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4034a4e6-58c8-46a7-b1d5-7fbb5db7c33c tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:18:03.171578 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4034a4e6-58c8-46a7-b1d5-7fbb5db7c33c tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:18:03.172017 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4034a4e6-58c8-46a7-b1d5-7fbb5db7c33c tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:18:03.172802 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4034a4e6-58c8-46a7-b1d5-7fbb5db7c33c tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:18:03.173317 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4034a4e6-58c8-46a7-b1d5-7fbb5db7c33c tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:18:03.309643 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4034a4e6-58c8-46a7-b1d5-7fbb5db7c33c tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:18:03.318060 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4034a4e6-58c8-46a7-b1d5-7fbb5db7c33c tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1261 microversion: 2.1 time: 0.158027 Jul 25 23:18:03.319295 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 543/1082] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:18:03 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:18:04.339838 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-d37f7d0a-70e5-46d6-9c0e-4c39741fa957 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:18:04.340511 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-d37f7d0a-70e5-46d6-9c0e-4c39741fa957 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:18:04.348566 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d37f7d0a-70e5-46d6-9c0e-4c39741fa957 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:18:04.349012 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d37f7d0a-70e5-46d6-9c0e-4c39741fa957 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:18:04.349867 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d37f7d0a-70e5-46d6-9c0e-4c39741fa957 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:18:04.350317 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d37f7d0a-70e5-46d6-9c0e-4c39741fa957 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:18:04.501472 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-d37f7d0a-70e5-46d6-9c0e-4c39741fa957 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:18:04.512016 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-d37f7d0a-70e5-46d6-9c0e-4c39741fa957 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1261 microversion: 2.1 time: 0.176511 Jul 25 23:18:04.512600 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 540/1083] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:18:04 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1261 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:18:05.537318 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-75e0b9cf-9fa7-4ee0-84a0-38f2fa40244e tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:18:05.537922 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-75e0b9cf-9fa7-4ee0-84a0-38f2fa40244e tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:18:05.540842 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=2 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:18:05.545209 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-75e0b9cf-9fa7-4ee0-84a0-38f2fa40244e tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:18:05.548119 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-75e0b9cf-9fa7-4ee0-84a0-38f2fa40244e tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:18:05.548119 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-75e0b9cf-9fa7-4ee0-84a0-38f2fa40244e tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:18:05.548119 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-75e0b9cf-9fa7-4ee0-84a0-38f2fa40244e tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:18:05.690514 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-75e0b9cf-9fa7-4ee0-84a0-38f2fa40244e tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:18:05.698766 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-75e0b9cf-9fa7-4ee0-84a0-38f2fa40244e tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1261 microversion: 2.1 time: 0.166812 Jul 25 23:18:05.699374 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 544/1084] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:18:05 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1261 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:18:06.721862 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-c2e6232c-ccb9-4dfc-a9cb-2a885e6636d4 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:18:06.722511 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-c2e6232c-ccb9-4dfc-a9cb-2a885e6636d4 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:18:06.728973 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c2e6232c-ccb9-4dfc-a9cb-2a885e6636d4 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:18:06.729449 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c2e6232c-ccb9-4dfc-a9cb-2a885e6636d4 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:18:06.730206 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c2e6232c-ccb9-4dfc-a9cb-2a885e6636d4 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:18:06.730640 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c2e6232c-ccb9-4dfc-a9cb-2a885e6636d4 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:18:06.873342 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-c2e6232c-ccb9-4dfc-a9cb-2a885e6636d4 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:18:06.881632 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-c2e6232c-ccb9-4dfc-a9cb-2a885e6636d4 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1261 microversion: 2.1 time: 0.164365 Jul 25 23:18:06.882200 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 541/1085] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:18:06 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:18:07.203352 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-91ea138b-0979-4c3c-a8e1-847e0aa522ef req-650609fc-3e7f-453e-9ed4-15805d6f7762 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aef45a51-92a9-46be-8adf-5d7d259dbe28", "name": "network-vif-plugged", "status": "completed", "tag": "0ea01c9b-495f-4404-af19-caa8c31834e3"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:18:07.214099 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-91ea138b-0979-4c3c-a8e1-847e0aa522ef req-650609fc-3e7f-453e-9ed4-15805d6f7762 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:18:07.214549 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-91ea138b-0979-4c3c-a8e1-847e0aa522ef req-650609fc-3e7f-453e-9ed4-15805d6f7762 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:18:07.225967 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-91ea138b-0979-4c3c-a8e1-847e0aa522ef req-650609fc-3e7f-453e-9ed4-15805d6f7762 service nova] Creating event network-vif-plugged:0ea01c9b-495f-4404-af19-caa8c31834e3 for instance aef45a51-92a9-46be-8adf-5d7d259dbe28 on hv-cinder-79760 Jul 25 23:18:07.231712 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-91ea138b-0979-4c3c-a8e1-847e0aa522ef req-650609fc-3e7f-453e-9ed4-15805d6f7762 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031964 Jul 25 23:18:07.232420 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 545/1086] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 25 23:18:07.903682 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-ee79262e-5217-4124-8d9f-61a8bd8fe0eb tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:18:07.904315 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-ee79262e-5217-4124-8d9f-61a8bd8fe0eb tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:18:07.911556 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ee79262e-5217-4124-8d9f-61a8bd8fe0eb tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:18:07.912006 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ee79262e-5217-4124-8d9f-61a8bd8fe0eb tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:18:07.912770 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ee79262e-5217-4124-8d9f-61a8bd8fe0eb tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:18:07.913231 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ee79262e-5217-4124-8d9f-61a8bd8fe0eb tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:18:08.045605 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-ee79262e-5217-4124-8d9f-61a8bd8fe0eb tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:18:08.053197 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-ee79262e-5217-4124-8d9f-61a8bd8fe0eb tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1261 microversion: 2.1 time: 0.153440 Jul 25 23:18:08.053763 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 542/1087] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:18:07 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:18:09.076934 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5a626481-1ac7-4ae1-9f99-a267e58399d8 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:18:09.077685 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-5a626481-1ac7-4ae1-9f99-a267e58399d8 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:18:09.084135 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5a626481-1ac7-4ae1-9f99-a267e58399d8 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:18:09.084625 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5a626481-1ac7-4ae1-9f99-a267e58399d8 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:18:09.085380 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5a626481-1ac7-4ae1-9f99-a267e58399d8 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:18:09.085814 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5a626481-1ac7-4ae1-9f99-a267e58399d8 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:18:09.247558 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-5a626481-1ac7-4ae1-9f99-a267e58399d8 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:18:09.258582 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-5a626481-1ac7-4ae1-9f99-a267e58399d8 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1444 microversion: 2.1 time: 0.186248 Jul 25 23:18:09.259442 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 546/1088] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:18:09 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1444 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:18:09.283936 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-9f201946-7477-4ddb-9cb6-ab94dd6720b3 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:18:09.284619 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-9f201946-7477-4ddb-9cb6-ab94dd6720b3 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:18:09.291868 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9f201946-7477-4ddb-9cb6-ab94dd6720b3 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:18:09.292314 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9f201946-7477-4ddb-9cb6-ab94dd6720b3 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:18:09.293089 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9f201946-7477-4ddb-9cb6-ab94dd6720b3 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:18:09.293559 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9f201946-7477-4ddb-9cb6-ab94dd6720b3 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:18:09.429479 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-9f201946-7477-4ddb-9cb6-ab94dd6720b3 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:18:09.437171 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-9f201946-7477-4ddb-9cb6-ab94dd6720b3 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1444 microversion: 2.1 time: 0.158437 Jul 25 23:18:09.437633 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 543/1089] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:18:09 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1444 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:18:11.609407 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-f73086a9-b276-4fbd-88c7-61402b81977e req-da223144-2f6c-40c3-b843-43691b0f9ca1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aef45a51-92a9-46be-8adf-5d7d259dbe28", "tag": "0ea01c9b-495f-4404-af19-caa8c31834e3"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:18:11.620526 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-f73086a9-b276-4fbd-88c7-61402b81977e req-da223144-2f6c-40c3-b843-43691b0f9ca1 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:18:11.620981 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-f73086a9-b276-4fbd-88c7-61402b81977e req-da223144-2f6c-40c3-b843-43691b0f9ca1 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:18:11.635117 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-f73086a9-b276-4fbd-88c7-61402b81977e req-da223144-2f6c-40c3-b843-43691b0f9ca1 service nova] Creating event network-changed:0ea01c9b-495f-4404-af19-caa8c31834e3 for instance aef45a51-92a9-46be-8adf-5d7d259dbe28 on hv-cinder-79760 Jul 25 23:18:11.640647 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-f73086a9-b276-4fbd-88c7-61402b81977e req-da223144-2f6c-40c3-b843-43691b0f9ca1 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034817 Jul 25 23:18:11.641276 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 547/1090] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:19:04.173618 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-92e15725-145a-4b72-8f55-5006141b7c4e tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-87704086", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1194749679", "security_groups": [{"name": "tempest-secgroup-smoke-488560059"}], "block_device_mapping_v2": [{"uuid": "8c0eda3d-11c8-4070-b949-5f6b01be5143", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ccff6ef8-9de0-43b7-8ccb-43439046b3f0"}]}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:19:04.191169 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:19:04.192231 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=58 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:19:04.440603 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.network.neutron [None req-92e15725-145a-4b72-8f55-5006141b7c4e tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] validate_networks() for [('ccff6ef8-9de0-43b7-8ccb-43439046b3f0', None, None, None, None, None)] {{(pid=118409) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 25 23:19:04.815997 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-92e15725-145a-4b72-8f55-5006141b7c4e tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Flavor limits 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 25 23:19:04.816426 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-92e15725-145a-4b72-8f55-5006141b7c4e tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Image limits 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 25 23:19:04.816933 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-92e15725-145a-4b72-8f55-5006141b7c4e tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Flavor pref 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 25 23:19:04.817387 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-92e15725-145a-4b72-8f55-5006141b7c4e tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Image pref 0:0:0 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 25 23:19:04.817802 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.virt.hardware [None req-92e15725-145a-4b72-8f55-5006141b7c4e tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 25 23:19:04.827348 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-92e15725-145a-4b72-8f55-5006141b7c4e tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:19:04.827793 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-92e15725-145a-4b72-8f55-5006141b7c4e tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:19:04.828599 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-92e15725-145a-4b72-8f55-5006141b7c4e tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:19:04.829034 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-92e15725-145a-4b72-8f55-5006141b7c4e tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:19:04.846662 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-92e15725-145a-4b72-8f55-5006141b7c4e tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Getting quotas for project f661a74731894c6e94eced8d8f7520e7. Resources: {'instances', 'cores', 'ram'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 25 23:19:04.850690 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.quota [None req-92e15725-145a-4b72-8f55-5006141b7c4e tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Getting quotas for user c862a035745641b5a8dde92a3d570b35 and project f661a74731894c6e94eced8d8f7520e7. Resources: {'instances', 'cores', 'ram'} {{(pid=118409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 25 23:19:04.910838 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-92e15725-145a-4b72-8f55-5006141b7c4e tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Going to run 1 instances... {{(pid=118409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 25 23:19:04.913046 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-92e15725-145a-4b72-8f55-5006141b7c4e tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: 4b7c733d-fad0-4aca-8d80-3f5e1f1987bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8c0eda3d-11c8-4070-b949-5f6b01be5143',volume_size=None,volume_type=None)] {{(pid=118409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 25 23:19:05.327220 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-92e15725-145a-4b72-8f55-5006141b7c4e tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.162836 Jul 25 23:19:05.328275 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 544/1091] 10.222.0.55 () {60 vars in 1147 bytes} [Mon Jul 25 23:19:04 2022] POST /compute/v2.1/servers => generated 405 bytes in 1165 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 25 23:19:05.336817 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:19:05.337888 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=46 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:19:05.342170 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-947da12c-9bbc-48e2-880c-ac959febb2c5 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:19:05.342963 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-947da12c-9bbc-48e2-880c-ac959febb2c5 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: 4b7c733d-fad0-4aca-8d80-3f5e1f1987bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:19:05.459372 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-947da12c-9bbc-48e2-880c-ac959febb2c5 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:19:05.466549 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-947da12c-9bbc-48e2-880c-ac959febb2c5 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf" status: 200 len: 1093 microversion: 2.1 time: 0.131289 Jul 25 23:19:05.467115 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 548/1092] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:19:05 2022] GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf => generated 1093 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:19:06.487426 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-8da4fe9f-86b1-45da-8a00-da4b5ff4c20b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:19:06.488121 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-8da4fe9f-86b1-45da-8a00-da4b5ff4c20b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: 4b7c733d-fad0-4aca-8d80-3f5e1f1987bf] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:19:06.498344 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8da4fe9f-86b1-45da-8a00-da4b5ff4c20b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:19:06.498836 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8da4fe9f-86b1-45da-8a00-da4b5ff4c20b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:19:06.499560 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8da4fe9f-86b1-45da-8a00-da4b5ff4c20b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:19:06.500085 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-8da4fe9f-86b1-45da-8a00-da4b5ff4c20b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:19:06.566190 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-8da4fe9f-86b1-45da-8a00-da4b5ff4c20b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:19:06.575701 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-8da4fe9f-86b1-45da-8a00-da4b5ff4c20b tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf" status: 200 len: 1135 microversion: 2.1 time: 0.091957 Jul 25 23:19:06.576386 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 545/1093] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:19:06 2022] GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf => generated 1135 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:19:07.597730 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-406f1dbf-8e28-4b12-a2ad-3fd853985fc0 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:19:07.598333 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-406f1dbf-8e28-4b12-a2ad-3fd853985fc0 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: 4b7c733d-fad0-4aca-8d80-3f5e1f1987bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:19:07.611455 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-406f1dbf-8e28-4b12-a2ad-3fd853985fc0 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:19:07.611912 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-406f1dbf-8e28-4b12-a2ad-3fd853985fc0 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:19:07.613180 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-406f1dbf-8e28-4b12-a2ad-3fd853985fc0 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:19:07.613622 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-406f1dbf-8e28-4b12-a2ad-3fd853985fc0 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:19:07.682105 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-406f1dbf-8e28-4b12-a2ad-3fd853985fc0 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:19:07.689902 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-406f1dbf-8e28-4b12-a2ad-3fd853985fc0 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf" status: 200 len: 1209 microversion: 2.1 time: 0.095995 Jul 25 23:19:07.690467 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 549/1094] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:19:07 2022] GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf => generated 1209 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:19:08.711111 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-e8a13924-322e-4932-b2a9-12cf7c7d2af9 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:19:08.711809 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-e8a13924-322e-4932-b2a9-12cf7c7d2af9 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: 4b7c733d-fad0-4aca-8d80-3f5e1f1987bf] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:19:08.718305 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e8a13924-322e-4932-b2a9-12cf7c7d2af9 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:19:08.718745 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e8a13924-322e-4932-b2a9-12cf7c7d2af9 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:19:08.719509 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e8a13924-322e-4932-b2a9-12cf7c7d2af9 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:19:08.719941 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e8a13924-322e-4932-b2a9-12cf7c7d2af9 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:19:09.208920 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-e8a13924-322e-4932-b2a9-12cf7c7d2af9 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:19:09.217755 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-e8a13924-322e-4932-b2a9-12cf7c7d2af9 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf" status: 200 len: 1276 microversion: 2.1 time: 0.510364 Jul 25 23:19:09.218581 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 546/1095] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:19:08 2022] GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf => generated 1276 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:19:09.449696 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-b71639a1-47e0-487b-ba3b-f4e3733075b4 req-304d6e84-5b3b-4f32-92eb-e2da04a9b04e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b7c733d-fad0-4aca-8d80-3f5e1f1987bf", "tag": "dd8cf6ea-f52b-4736-a385-d5445fecee2c"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:19:09.462752 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-b71639a1-47e0-487b-ba3b-f4e3733075b4 req-304d6e84-5b3b-4f32-92eb-e2da04a9b04e service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:19:09.465036 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-b71639a1-47e0-487b-ba3b-f4e3733075b4 req-304d6e84-5b3b-4f32-92eb-e2da04a9b04e service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:19:09.477369 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-b71639a1-47e0-487b-ba3b-f4e3733075b4 req-304d6e84-5b3b-4f32-92eb-e2da04a9b04e service nova] Creating event network-changed:dd8cf6ea-f52b-4736-a385-d5445fecee2c for instance 4b7c733d-fad0-4aca-8d80-3f5e1f1987bf on hv-cinder-79760 Jul 25 23:19:09.482642 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-b71639a1-47e0-487b-ba3b-f4e3733075b4 req-304d6e84-5b3b-4f32-92eb-e2da04a9b04e service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039473 Jul 25 23:19:09.483629 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 550/1096] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:19:09.545649 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 23:19:09.546201 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Mon Jul 25 23:19:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 23:19:10.239275 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-0afe7cd1-321b-45e6-8a41-21ca81fad0fc tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:19:10.239874 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-0afe7cd1-321b-45e6-8a41-21ca81fad0fc tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: 4b7c733d-fad0-4aca-8d80-3f5e1f1987bf] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:19:10.246961 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0afe7cd1-321b-45e6-8a41-21ca81fad0fc tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:19:10.247419 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0afe7cd1-321b-45e6-8a41-21ca81fad0fc tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:19:10.248196 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0afe7cd1-321b-45e6-8a41-21ca81fad0fc tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:19:10.248825 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-0afe7cd1-321b-45e6-8a41-21ca81fad0fc tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:19:10.395830 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-0afe7cd1-321b-45e6-8a41-21ca81fad0fc tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:19:10.403592 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-0afe7cd1-321b-45e6-8a41-21ca81fad0fc tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf" status: 200 len: 1264 microversion: 2.1 time: 0.168242 Jul 25 23:19:10.404180 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 547/1097] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:19:10 2022] GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:19:11.426731 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-da73e53c-c98d-4ddf-adfc-1e1d2e3d9e42 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:19:11.427591 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-da73e53c-c98d-4ddf-adfc-1e1d2e3d9e42 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: 4b7c733d-fad0-4aca-8d80-3f5e1f1987bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:19:11.436034 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-da73e53c-c98d-4ddf-adfc-1e1d2e3d9e42 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:19:11.436495 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-da73e53c-c98d-4ddf-adfc-1e1d2e3d9e42 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:19:11.437368 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-da73e53c-c98d-4ddf-adfc-1e1d2e3d9e42 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:19:11.437740 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-da73e53c-c98d-4ddf-adfc-1e1d2e3d9e42 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:19:11.575275 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-da73e53c-c98d-4ddf-adfc-1e1d2e3d9e42 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:19:11.583452 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-da73e53c-c98d-4ddf-adfc-1e1d2e3d9e42 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf" status: 200 len: 1264 microversion: 2.1 time: 0.162455 Jul 25 23:19:11.584923 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 551/1098] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:19:11 2022] GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:19:12.603805 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-1cd4116b-b714-4e15-bc2a-4d86021abf21 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:19:12.604409 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-1cd4116b-b714-4e15-bc2a-4d86021abf21 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: 4b7c733d-fad0-4aca-8d80-3f5e1f1987bf] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:19:12.610922 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1cd4116b-b714-4e15-bc2a-4d86021abf21 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:19:12.611366 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1cd4116b-b714-4e15-bc2a-4d86021abf21 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:19:12.612128 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1cd4116b-b714-4e15-bc2a-4d86021abf21 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:19:12.612560 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1cd4116b-b714-4e15-bc2a-4d86021abf21 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:19:12.750408 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-1cd4116b-b714-4e15-bc2a-4d86021abf21 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:19:12.757878 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-1cd4116b-b714-4e15-bc2a-4d86021abf21 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf" status: 200 len: 1264 microversion: 2.1 time: 0.157961 Jul 25 23:19:12.758442 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 548/1099] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:19:12 2022] GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:19:13.781162 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0c537b56-7ea1-4e9c-9aae-40f953d231a4 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:19:13.781777 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-0c537b56-7ea1-4e9c-9aae-40f953d231a4 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: 4b7c733d-fad0-4aca-8d80-3f5e1f1987bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:19:13.788368 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0c537b56-7ea1-4e9c-9aae-40f953d231a4 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:19:13.788808 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0c537b56-7ea1-4e9c-9aae-40f953d231a4 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:19:13.789598 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0c537b56-7ea1-4e9c-9aae-40f953d231a4 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:19:13.790026 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-0c537b56-7ea1-4e9c-9aae-40f953d231a4 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:19:13.928450 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-0c537b56-7ea1-4e9c-9aae-40f953d231a4 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:19:13.936098 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-0c537b56-7ea1-4e9c-9aae-40f953d231a4 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf" status: 200 len: 1264 microversion: 2.1 time: 0.159742 Jul 25 23:19:13.936656 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 552/1100] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:19:13 2022] GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:19:14.957510 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-64115634-a823-49cd-bee2-318fd865f9d4 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:19:14.958125 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-64115634-a823-49cd-bee2-318fd865f9d4 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: 4b7c733d-fad0-4aca-8d80-3f5e1f1987bf] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:19:14.960424 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell0:SELECT=2 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:19:14.961104 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell0:SELECT=6 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:19:14.967278 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-64115634-a823-49cd-bee2-318fd865f9d4 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:19:14.973673 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-64115634-a823-49cd-bee2-318fd865f9d4 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:19:14.973673 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-64115634-a823-49cd-bee2-318fd865f9d4 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:19:14.973673 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-64115634-a823-49cd-bee2-318fd865f9d4 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:19:15.104111 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-64115634-a823-49cd-bee2-318fd865f9d4 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:19:15.112516 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-64115634-a823-49cd-bee2-318fd865f9d4 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf" status: 200 len: 1264 microversion: 2.1 time: 0.158736 Jul 25 23:19:15.113009 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 549/1101] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:19:14 2022] GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:19:16.134352 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-33b4195b-03fc-4826-b9fd-5c8195d38b68 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:19:16.134963 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-33b4195b-03fc-4826-b9fd-5c8195d38b68 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: 4b7c733d-fad0-4aca-8d80-3f5e1f1987bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:19:16.137784 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell0:SELECT=2 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:19:16.142778 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-33b4195b-03fc-4826-b9fd-5c8195d38b68 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:19:16.143236 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-33b4195b-03fc-4826-b9fd-5c8195d38b68 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:19:16.144088 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-33b4195b-03fc-4826-b9fd-5c8195d38b68 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:19:16.144525 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-33b4195b-03fc-4826-b9fd-5c8195d38b68 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:19:16.274553 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-33b4195b-03fc-4826-b9fd-5c8195d38b68 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:19:16.282210 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-33b4195b-03fc-4826-b9fd-5c8195d38b68 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf" status: 200 len: 1264 microversion: 2.1 time: 0.151744 Jul 25 23:19:16.282775 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 553/1102] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:19:16 2022] GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:19:17.302831 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-ad8e985d-dbc6-402d-8f79-715c8c4f2178 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:19:17.309936 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-ad8e985d-dbc6-402d-8f79-715c8c4f2178 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: 4b7c733d-fad0-4aca-8d80-3f5e1f1987bf] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:19:17.310380 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ad8e985d-dbc6-402d-8f79-715c8c4f2178 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:19:17.310979 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ad8e985d-dbc6-402d-8f79-715c8c4f2178 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:19:17.311707 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ad8e985d-dbc6-402d-8f79-715c8c4f2178 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:19:17.312154 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ad8e985d-dbc6-402d-8f79-715c8c4f2178 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:19:17.453167 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-ad8e985d-dbc6-402d-8f79-715c8c4f2178 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:19:17.460916 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-ad8e985d-dbc6-402d-8f79-715c8c4f2178 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf" status: 200 len: 1264 microversion: 2.1 time: 0.161905 Jul 25 23:19:17.461509 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 550/1103] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:19:17 2022] GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:19:18.482180 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-3d5e8426-572d-4ee8-923b-728fd8760346 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:19:18.482848 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-3d5e8426-572d-4ee8-923b-728fd8760346 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: 4b7c733d-fad0-4aca-8d80-3f5e1f1987bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:19:18.489289 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3d5e8426-572d-4ee8-923b-728fd8760346 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:19:18.489738 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3d5e8426-572d-4ee8-923b-728fd8760346 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:19:18.490496 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3d5e8426-572d-4ee8-923b-728fd8760346 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:19:18.490928 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3d5e8426-572d-4ee8-923b-728fd8760346 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:19:18.627300 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-3d5e8426-572d-4ee8-923b-728fd8760346 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:19:18.634844 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-3d5e8426-572d-4ee8-923b-728fd8760346 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf" status: 200 len: 1264 microversion: 2.1 time: 0.156999 Jul 25 23:19:18.635413 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 554/1104] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:19:18 2022] GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:19:19.455885 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-bef4b7f3-6d59-42b2-bdf4-d2826be8cb57 req-e9614210-d27b-4b74-b862-6a6f8aeb3bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b7c733d-fad0-4aca-8d80-3f5e1f1987bf", "name": "network-vif-plugged", "status": "completed", "tag": "dd8cf6ea-f52b-4736-a385-d5445fecee2c"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:19:19.466552 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-bef4b7f3-6d59-42b2-bdf4-d2826be8cb57 req-e9614210-d27b-4b74-b862-6a6f8aeb3bd8 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:19:19.466994 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-bef4b7f3-6d59-42b2-bdf4-d2826be8cb57 req-e9614210-d27b-4b74-b862-6a6f8aeb3bd8 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:19:19.480739 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-bef4b7f3-6d59-42b2-bdf4-d2826be8cb57 req-e9614210-d27b-4b74-b862-6a6f8aeb3bd8 service nova] Creating event network-vif-plugged:dd8cf6ea-f52b-4736-a385-d5445fecee2c for instance 4b7c733d-fad0-4aca-8d80-3f5e1f1987bf on hv-cinder-79760 Jul 25 23:19:19.487576 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-bef4b7f3-6d59-42b2-bdf4-d2826be8cb57 req-e9614210-d27b-4b74-b862-6a6f8aeb3bd8 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034549 Jul 25 23:19:19.487576 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 551/1105] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:19:19.656096 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-5d25bcba-d2d2-498b-914c-a0daad44eb84 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:19:19.656673 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-5d25bcba-d2d2-498b-914c-a0daad44eb84 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: 4b7c733d-fad0-4aca-8d80-3f5e1f1987bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:19:19.663267 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5d25bcba-d2d2-498b-914c-a0daad44eb84 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:19:19.663711 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5d25bcba-d2d2-498b-914c-a0daad44eb84 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:19:19.664471 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5d25bcba-d2d2-498b-914c-a0daad44eb84 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:19:19.664896 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-5d25bcba-d2d2-498b-914c-a0daad44eb84 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:19:19.801822 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-5d25bcba-d2d2-498b-914c-a0daad44eb84 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:19:19.810195 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-5d25bcba-d2d2-498b-914c-a0daad44eb84 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf" status: 200 len: 1264 microversion: 2.1 time: 0.157475 Jul 25 23:19:19.811005 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 555/1106] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:19:19 2022] GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:19:20.833486 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-1111b6da-95b4-4d87-8766-5b5ca31b7f13 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:19:20.834063 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-1111b6da-95b4-4d87-8766-5b5ca31b7f13 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: 4b7c733d-fad0-4aca-8d80-3f5e1f1987bf] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:19:20.840261 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1111b6da-95b4-4d87-8766-5b5ca31b7f13 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:19:20.841294 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1111b6da-95b4-4d87-8766-5b5ca31b7f13 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:19:20.842063 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1111b6da-95b4-4d87-8766-5b5ca31b7f13 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:19:20.842496 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-1111b6da-95b4-4d87-8766-5b5ca31b7f13 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:19:20.980526 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-1111b6da-95b4-4d87-8766-5b5ca31b7f13 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:19:20.988923 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-1111b6da-95b4-4d87-8766-5b5ca31b7f13 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf" status: 200 len: 1264 microversion: 2.1 time: 0.160316 Jul 25 23:19:20.996153 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 552/1107] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:19:20 2022] GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:19:22.063785 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b103b6b3-c70a-4f85-b073-0fec75170c27 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:19:22.064395 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b103b6b3-c70a-4f85-b073-0fec75170c27 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: 4b7c733d-fad0-4aca-8d80-3f5e1f1987bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:19:22.071055 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b103b6b3-c70a-4f85-b073-0fec75170c27 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:19:22.071549 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b103b6b3-c70a-4f85-b073-0fec75170c27 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:19:22.072315 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b103b6b3-c70a-4f85-b073-0fec75170c27 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:19:22.072749 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b103b6b3-c70a-4f85-b073-0fec75170c27 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:19:22.209749 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-b103b6b3-c70a-4f85-b073-0fec75170c27 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:19:22.218193 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b103b6b3-c70a-4f85-b073-0fec75170c27 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf" status: 200 len: 1450 microversion: 2.1 time: 0.210950 Jul 25 23:19:22.219441 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 556/1108] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:19:22 2022] GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf => generated 1450 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:19:22.238379 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-25f0184c-3645-45b6-a3a4-51bd997c6a47 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:19:22.238987 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-25f0184c-3645-45b6-a3a4-51bd997c6a47 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: 4b7c733d-fad0-4aca-8d80-3f5e1f1987bf] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:19:22.245699 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-25f0184c-3645-45b6-a3a4-51bd997c6a47 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:19:22.246149 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-25f0184c-3645-45b6-a3a4-51bd997c6a47 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:19:22.246912 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-25f0184c-3645-45b6-a3a4-51bd997c6a47 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:19:22.247352 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-25f0184c-3645-45b6-a3a4-51bd997c6a47 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:19:22.380594 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-25f0184c-3645-45b6-a3a4-51bd997c6a47 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:19:22.389177 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-25f0184c-3645-45b6-a3a4-51bd997c6a47 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf" status: 200 len: 1450 microversion: 2.1 time: 0.154223 Jul 25 23:19:22.389781 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 553/1109] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:19:22 2022] GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:19:24.338179 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-42ec4a89-f101-4cf3-be19-f7f7d0c19594 req-d2b48b71-9bc9-4ae7-8e4a-22c6c083c298 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b7c733d-fad0-4aca-8d80-3f5e1f1987bf", "tag": "dd8cf6ea-f52b-4736-a385-d5445fecee2c"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:19:24.347723 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-42ec4a89-f101-4cf3-be19-f7f7d0c19594 req-d2b48b71-9bc9-4ae7-8e4a-22c6c083c298 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:19:24.348164 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-42ec4a89-f101-4cf3-be19-f7f7d0c19594 req-d2b48b71-9bc9-4ae7-8e4a-22c6c083c298 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:19:24.360655 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-42ec4a89-f101-4cf3-be19-f7f7d0c19594 req-d2b48b71-9bc9-4ae7-8e4a-22c6c083c298 service nova] Creating event network-changed:dd8cf6ea-f52b-4736-a385-d5445fecee2c for instance 4b7c733d-fad0-4aca-8d80-3f5e1f1987bf on hv-cinder-79760 Jul 25 23:19:24.366308 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-42ec4a89-f101-4cf3-be19-f7f7d0c19594 req-d2b48b71-9bc9-4ae7-8e4a-22c6c083c298 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031706 Jul 25 23:19:24.367213 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 557/1110] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:20:07.050053 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-597133a3-f385-4fdd-87e6-46189dc6b033 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:20:07.050941 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-597133a3-f385-4fdd-87e6-46189dc6b033 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:07.052762 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:20:07.053483 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=52 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:20:07.059050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-597133a3-f385-4fdd-87e6-46189dc6b033 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:07.059500 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-597133a3-f385-4fdd-87e6-46189dc6b033 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:07.060296 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-597133a3-f385-4fdd-87e6-46189dc6b033 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:07.060766 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-597133a3-f385-4fdd-87e6-46189dc6b033 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:07.084298 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.objects.instance [None req-597133a3-f385-4fdd-87e6-46189dc6b033 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lazy-loading 'flavor' on Instance uuid aef45a51-92a9-46be-8adf-5d7d259dbe28 {{(pid=118409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 23:20:07.431705 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-597133a3-f385-4fdd-87e6-46189dc6b033 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "POST /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28/action" status: 202 len: 0 microversion: 2.1 time: 0.385523 Jul 25 23:20:07.432250 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 554/1111] 10.222.0.55 () {60 vars in 1278 bytes} [Mon Jul 25 23:20:07 2022] POST /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 23:20:07.438697 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=22 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:20:07.439533 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=46 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:20:07.443665 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-3faeecef-f89b-48fd-8ecb-d66296b3f226 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:07.449628 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-3faeecef-f89b-48fd-8ecb-d66296b3f226 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:07.451189 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3faeecef-f89b-48fd-8ecb-d66296b3f226 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:07.451594 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3faeecef-f89b-48fd-8ecb-d66296b3f226 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:07.452421 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3faeecef-f89b-48fd-8ecb-d66296b3f226 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:07.452878 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3faeecef-f89b-48fd-8ecb-d66296b3f226 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:07.592214 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-3faeecef-f89b-48fd-8ecb-d66296b3f226 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:20:07.599846 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-3faeecef-f89b-48fd-8ecb-d66296b3f226 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1568 microversion: 2.1 time: 0.162855 Jul 25 23:20:07.600414 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 558/1112] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:20:07 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:20:08.624175 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-d63e9b1a-85a9-4223-9e71-9f65bf75b354 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:08.624889 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-d63e9b1a-85a9-4223-9e71-9f65bf75b354 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:08.631196 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d63e9b1a-85a9-4223-9e71-9f65bf75b354 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:08.631641 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d63e9b1a-85a9-4223-9e71-9f65bf75b354 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:08.632759 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d63e9b1a-85a9-4223-9e71-9f65bf75b354 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:08.633229 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-d63e9b1a-85a9-4223-9e71-9f65bf75b354 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:08.769452 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-d63e9b1a-85a9-4223-9e71-9f65bf75b354 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:20:08.777380 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-d63e9b1a-85a9-4223-9e71-9f65bf75b354 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1568 microversion: 2.1 time: 0.157952 Jul 25 23:20:08.777944 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 555/1113] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:20:08 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:20:09.799857 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-3f543ed7-2bec-40c8-a873-a31de457784c tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:09.800445 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-3f543ed7-2bec-40c8-a873-a31de457784c tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:09.808252 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3f543ed7-2bec-40c8-a873-a31de457784c tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:09.808692 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3f543ed7-2bec-40c8-a873-a31de457784c tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:09.809474 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3f543ed7-2bec-40c8-a873-a31de457784c tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:09.809903 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3f543ed7-2bec-40c8-a873-a31de457784c tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:09.944466 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-3f543ed7-2bec-40c8-a873-a31de457784c tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:20:09.952898 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-3f543ed7-2bec-40c8-a873-a31de457784c tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1568 microversion: 2.1 time: 0.156853 Jul 25 23:20:09.953520 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 559/1114] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:20:09 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:20:10.974562 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-2380d957-0fb7-434f-8f00-094d0a0881dc tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:10.975167 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-2380d957-0fb7-434f-8f00-094d0a0881dc tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:10.981752 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2380d957-0fb7-434f-8f00-094d0a0881dc tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:10.982194 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2380d957-0fb7-434f-8f00-094d0a0881dc tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:10.982982 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2380d957-0fb7-434f-8f00-094d0a0881dc tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:10.983414 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2380d957-0fb7-434f-8f00-094d0a0881dc tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:11.114038 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-2380d957-0fb7-434f-8f00-094d0a0881dc tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:20:11.121819 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-2380d957-0fb7-434f-8f00-094d0a0881dc tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1568 microversion: 2.1 time: 0.151102 Jul 25 23:20:11.122385 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 556/1115] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:20:10 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:20:12.144107 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-e54fb7bd-ca01-4aaa-b262-f6c03d37962f tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:12.144677 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-e54fb7bd-ca01-4aaa-b262-f6c03d37962f tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:12.152184 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e54fb7bd-ca01-4aaa-b262-f6c03d37962f tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:12.152629 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e54fb7bd-ca01-4aaa-b262-f6c03d37962f tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:12.154067 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e54fb7bd-ca01-4aaa-b262-f6c03d37962f tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:12.154067 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-e54fb7bd-ca01-4aaa-b262-f6c03d37962f tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:12.299274 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-e54fb7bd-ca01-4aaa-b262-f6c03d37962f tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:20:12.307109 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-e54fb7bd-ca01-4aaa-b262-f6c03d37962f tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1568 microversion: 2.1 time: 0.167024 Jul 25 23:20:12.307676 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 560/1116] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:20:12 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:20:13.329777 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-663e8f97-8534-4874-92b1-52166b6eab15 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:13.330340 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-663e8f97-8534-4874-92b1-52166b6eab15 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:13.336934 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-663e8f97-8534-4874-92b1-52166b6eab15 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:13.337403 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-663e8f97-8534-4874-92b1-52166b6eab15 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:13.338157 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-663e8f97-8534-4874-92b1-52166b6eab15 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:13.338583 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-663e8f97-8534-4874-92b1-52166b6eab15 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:13.480567 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-663e8f97-8534-4874-92b1-52166b6eab15 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:20:13.488282 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-663e8f97-8534-4874-92b1-52166b6eab15 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1568 microversion: 2.1 time: 0.162376 Jul 25 23:20:13.488841 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 557/1117] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:20:13 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:20:14.510969 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-4e0e5298-bc85-4b8d-86e6-2bbea2203d29 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:14.511564 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-4e0e5298-bc85-4b8d-86e6-2bbea2203d29 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:14.518374 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4e0e5298-bc85-4b8d-86e6-2bbea2203d29 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:14.518822 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4e0e5298-bc85-4b8d-86e6-2bbea2203d29 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:14.519598 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4e0e5298-bc85-4b8d-86e6-2bbea2203d29 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:14.520035 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-4e0e5298-bc85-4b8d-86e6-2bbea2203d29 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:14.900114 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-4e0e5298-bc85-4b8d-86e6-2bbea2203d29 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:20:14.907544 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-4e0e5298-bc85-4b8d-86e6-2bbea2203d29 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1568 microversion: 2.1 time: 0.401422 Jul 25 23:20:14.908094 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 561/1118] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:20:14 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1568 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:20:15.930191 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-e4cbf8c4-d9c7-4b5d-8717-81ce5b85840c tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:15.930839 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-e4cbf8c4-d9c7-4b5d-8717-81ce5b85840c tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:15.938305 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e4cbf8c4-d9c7-4b5d-8717-81ce5b85840c tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:15.938757 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e4cbf8c4-d9c7-4b5d-8717-81ce5b85840c tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:15.939540 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e4cbf8c4-d9c7-4b5d-8717-81ce5b85840c tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:15.939977 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-e4cbf8c4-d9c7-4b5d-8717-81ce5b85840c tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:16.071962 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-e4cbf8c4-d9c7-4b5d-8717-81ce5b85840c tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:20:16.079685 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-e4cbf8c4-d9c7-4b5d-8717-81ce5b85840c tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1568 microversion: 2.1 time: 0.153426 Jul 25 23:20:16.080251 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 558/1119] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:20:15 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:20:17.100779 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-19edbeec-f38a-4bf0-9685-be885dfdccfb tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:17.101425 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-19edbeec-f38a-4bf0-9685-be885dfdccfb tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:17.108215 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-19edbeec-f38a-4bf0-9685-be885dfdccfb tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:17.108715 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-19edbeec-f38a-4bf0-9685-be885dfdccfb tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:17.109470 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-19edbeec-f38a-4bf0-9685-be885dfdccfb tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:17.109906 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-19edbeec-f38a-4bf0-9685-be885dfdccfb tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:17.244918 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-19edbeec-f38a-4bf0-9685-be885dfdccfb tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:20:17.253108 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-19edbeec-f38a-4bf0-9685-be885dfdccfb tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1568 microversion: 2.1 time: 0.156162 Jul 25 23:20:17.253697 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 562/1120] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:20:17 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:20:18.275515 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-b84216e2-1ad2-422c-a61e-7c8175228ef2 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:18.276131 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-b84216e2-1ad2-422c-a61e-7c8175228ef2 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:18.283380 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b84216e2-1ad2-422c-a61e-7c8175228ef2 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:18.283857 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b84216e2-1ad2-422c-a61e-7c8175228ef2 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:18.284611 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b84216e2-1ad2-422c-a61e-7c8175228ef2 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:18.285043 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-b84216e2-1ad2-422c-a61e-7c8175228ef2 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:18.421743 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-b84216e2-1ad2-422c-a61e-7c8175228ef2 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:20:18.429562 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-b84216e2-1ad2-422c-a61e-7c8175228ef2 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1568 microversion: 2.1 time: 0.157882 Jul 25 23:20:18.430146 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 559/1121] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:20:18 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:20:19.451587 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-bb761c31-5cd4-42b4-86e4-2d36839f20f1 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:19.452201 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-bb761c31-5cd4-42b4-86e4-2d36839f20f1 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:19.458954 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bb761c31-5cd4-42b4-86e4-2d36839f20f1 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:19.459400 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bb761c31-5cd4-42b4-86e4-2d36839f20f1 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:19.460208 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bb761c31-5cd4-42b4-86e4-2d36839f20f1 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:19.460638 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-bb761c31-5cd4-42b4-86e4-2d36839f20f1 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:19.606807 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-bb761c31-5cd4-42b4-86e4-2d36839f20f1 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:20:19.614598 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-bb761c31-5cd4-42b4-86e4-2d36839f20f1 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1568 microversion: 2.1 time: 0.167119 Jul 25 23:20:19.615216 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 563/1122] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:20:19 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:20:20.636410 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-39dc6cf9-5d36-4ba3-b1b8-5de6752a1c57 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:20.637015 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-39dc6cf9-5d36-4ba3-b1b8-5de6752a1c57 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:20.643574 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-39dc6cf9-5d36-4ba3-b1b8-5de6752a1c57 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:20.644023 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-39dc6cf9-5d36-4ba3-b1b8-5de6752a1c57 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:20.644799 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-39dc6cf9-5d36-4ba3-b1b8-5de6752a1c57 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:20.645264 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-39dc6cf9-5d36-4ba3-b1b8-5de6752a1c57 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:20.791255 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-39dc6cf9-5d36-4ba3-b1b8-5de6752a1c57 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:20:20.799351 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-39dc6cf9-5d36-4ba3-b1b8-5de6752a1c57 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1568 microversion: 2.1 time: 0.167320 Jul 25 23:20:20.799939 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 560/1123] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:20:20 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:20:21.821097 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-3cab256f-d3da-4187-8f49-59947db6eefd tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:21.821742 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-3cab256f-d3da-4187-8f49-59947db6eefd tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:21.829068 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3cab256f-d3da-4187-8f49-59947db6eefd tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:21.829546 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3cab256f-d3da-4187-8f49-59947db6eefd tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:21.830316 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3cab256f-d3da-4187-8f49-59947db6eefd tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:21.830748 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3cab256f-d3da-4187-8f49-59947db6eefd tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:21.968568 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-3cab256f-d3da-4187-8f49-59947db6eefd tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:20:21.976415 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-3cab256f-d3da-4187-8f49-59947db6eefd tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1509 microversion: 2.1 time: 0.159171 Jul 25 23:20:21.976994 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 564/1124] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:20:21 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:20:21.998681 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-04c4e539-45cf-4557-803b-88deeef656e6 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:20:21.999253 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-04c4e539-45cf-4557-803b-88deeef656e6 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:22.005884 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-04c4e539-45cf-4557-803b-88deeef656e6 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:22.006335 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-04c4e539-45cf-4557-803b-88deeef656e6 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:22.007150 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-04c4e539-45cf-4557-803b-88deeef656e6 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:22.007568 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-04c4e539-45cf-4557-803b-88deeef656e6 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:22.228563 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-04c4e539-45cf-4557-803b-88deeef656e6 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "POST /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28/action" status: 202 len: 0 microversion: 2.1 time: 0.234420 Jul 25 23:20:22.229200 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 561/1125] 10.222.0.55 () {60 vars in 1278 bytes} [Mon Jul 25 23:20:21 2022] POST /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 23:20:22.238058 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-af86c9fd-ddeb-4cdf-9df5-8d62b15761ae tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:22.238684 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-af86c9fd-ddeb-4cdf-9df5-8d62b15761ae tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:22.244895 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-af86c9fd-ddeb-4cdf-9df5-8d62b15761ae tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:22.246179 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-af86c9fd-ddeb-4cdf-9df5-8d62b15761ae tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:22.247199 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-af86c9fd-ddeb-4cdf-9df5-8d62b15761ae tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:22.247676 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-af86c9fd-ddeb-4cdf-9df5-8d62b15761ae tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:22.384272 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-af86c9fd-ddeb-4cdf-9df5-8d62b15761ae tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:20:22.393297 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-af86c9fd-ddeb-4cdf-9df5-8d62b15761ae tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1517 microversion: 2.1 time: 0.159020 Jul 25 23:20:22.393880 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 565/1126] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:20:22 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:20:23.414974 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-34717eb6-9de6-4376-bacb-d49e365be919 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:23.415676 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-34717eb6-9de6-4376-bacb-d49e365be919 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:23.422808 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-34717eb6-9de6-4376-bacb-d49e365be919 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:23.423244 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-34717eb6-9de6-4376-bacb-d49e365be919 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:23.424057 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-34717eb6-9de6-4376-bacb-d49e365be919 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:23.424627 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-34717eb6-9de6-4376-bacb-d49e365be919 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:23.588046 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-34717eb6-9de6-4376-bacb-d49e365be919 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:20:23.596505 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-34717eb6-9de6-4376-bacb-d49e365be919 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1517 microversion: 2.1 time: 0.185395 Jul 25 23:20:23.597762 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 562/1127] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:20:23 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1517 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:20:23.681853 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-e238f2df-e3f1-49a5-8740-c306f5d1fa79 req-3cf52d5d-7c19-420c-82a7-53fb2883bea2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aef45a51-92a9-46be-8adf-5d7d259dbe28", "name": "network-vif-unplugged", "status": "completed", "tag": "0ea01c9b-495f-4404-af19-caa8c31834e3"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:20:23.693083 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-e238f2df-e3f1-49a5-8740-c306f5d1fa79 req-3cf52d5d-7c19-420c-82a7-53fb2883bea2 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:23.698797 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-e238f2df-e3f1-49a5-8740-c306f5d1fa79 req-3cf52d5d-7c19-420c-82a7-53fb2883bea2 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:23.717072 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.compute.server_external_events [req-e238f2df-e3f1-49a5-8740-c306f5d1fa79 req-3cf52d5d-7c19-420c-82a7-53fb2883bea2 service nova] Unable to find a host for instance aef45a51-92a9-46be-8adf-5d7d259dbe28. Dropping event network-vif-unplugged {{(pid=118410) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 25 23:20:23.718164 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-e238f2df-e3f1-49a5-8740-c306f5d1fa79 req-3cf52d5d-7c19-420c-82a7-53fb2883bea2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.102091 Jul 25 23:20:23.719244 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 566/1128] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 104 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 25 23:20:24.618400 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-263c7db1-e287-4182-8c81-9da26369bc65 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:24.618974 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-263c7db1-e287-4182-8c81-9da26369bc65 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:24.626170 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-263c7db1-e287-4182-8c81-9da26369bc65 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:24.626613 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-263c7db1-e287-4182-8c81-9da26369bc65 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:24.627382 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-263c7db1-e287-4182-8c81-9da26369bc65 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:24.627814 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-263c7db1-e287-4182-8c81-9da26369bc65 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:24.763342 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-263c7db1-e287-4182-8c81-9da26369bc65 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:20:24.771171 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-263c7db1-e287-4182-8c81-9da26369bc65 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1517 microversion: 2.1 time: 0.156642 Jul 25 23:20:24.773311 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 563/1129] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:20:24 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:20:25.791987 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-9f2c5159-99ef-4b50-b0b4-9b8b29f4cf9d tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:25.793068 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-9f2c5159-99ef-4b50-b0b4-9b8b29f4cf9d tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:25.799524 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9f2c5159-99ef-4b50-b0b4-9b8b29f4cf9d tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:25.799960 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9f2c5159-99ef-4b50-b0b4-9b8b29f4cf9d tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:25.800710 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9f2c5159-99ef-4b50-b0b4-9b8b29f4cf9d tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:25.801159 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-9f2c5159-99ef-4b50-b0b4-9b8b29f4cf9d tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:25.938068 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-9f2c5159-99ef-4b50-b0b4-9b8b29f4cf9d tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:20:25.945589 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-9f2c5159-99ef-4b50-b0b4-9b8b29f4cf9d tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1517 microversion: 2.1 time: 0.157572 Jul 25 23:20:25.946157 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 567/1130] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:20:25 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:20:26.968314 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-c473574e-748f-4fbb-beb0-1d7691978be5 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:26.968877 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-c473574e-748f-4fbb-beb0-1d7691978be5 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:26.975382 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c473574e-748f-4fbb-beb0-1d7691978be5 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:26.975827 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c473574e-748f-4fbb-beb0-1d7691978be5 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:26.976589 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c473574e-748f-4fbb-beb0-1d7691978be5 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:26.977047 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-c473574e-748f-4fbb-beb0-1d7691978be5 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:27.110130 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-c473574e-748f-4fbb-beb0-1d7691978be5 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:20:27.117982 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-c473574e-748f-4fbb-beb0-1d7691978be5 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1517 microversion: 2.1 time: 0.154088 Jul 25 23:20:27.118556 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 564/1131] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:20:26 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:20:28.143356 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-410a61c5-cbb8-4027-af13-1939200f9ee4 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:28.143987 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-410a61c5-cbb8-4027-af13-1939200f9ee4 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:28.150737 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-410a61c5-cbb8-4027-af13-1939200f9ee4 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:28.151252 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-410a61c5-cbb8-4027-af13-1939200f9ee4 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:28.152561 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-410a61c5-cbb8-4027-af13-1939200f9ee4 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:28.152991 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-410a61c5-cbb8-4027-af13-1939200f9ee4 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:28.300252 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-410a61c5-cbb8-4027-af13-1939200f9ee4 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:20:28.308758 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-410a61c5-cbb8-4027-af13-1939200f9ee4 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1519 microversion: 2.1 time: 0.170665 Jul 25 23:20:28.309378 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 568/1132] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:20:28 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1519 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:20:29.330963 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-446d8092-86f0-4e5f-abcc-e2660543f0ea tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:29.331578 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-446d8092-86f0-4e5f-abcc-e2660543f0ea tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:29.344667 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-446d8092-86f0-4e5f-abcc-e2660543f0ea tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:29.345138 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-446d8092-86f0-4e5f-abcc-e2660543f0ea tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:29.346031 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-446d8092-86f0-4e5f-abcc-e2660543f0ea tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:29.346467 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-446d8092-86f0-4e5f-abcc-e2660543f0ea tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:29.594182 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-446d8092-86f0-4e5f-abcc-e2660543f0ea tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:20:29.602387 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-446d8092-86f0-4e5f-abcc-e2660543f0ea tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1575 microversion: 2.1 time: 0.275467 Jul 25 23:20:29.603307 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 565/1133] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:20:29 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1575 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:20:30.626304 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-38279986-03ba-4803-afba-4154d7b6595c tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:30.626909 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-38279986-03ba-4803-afba-4154d7b6595c tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:30.633590 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-38279986-03ba-4803-afba-4154d7b6595c tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:30.634036 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-38279986-03ba-4803-afba-4154d7b6595c tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:30.634800 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-38279986-03ba-4803-afba-4154d7b6595c tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:30.635232 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-38279986-03ba-4803-afba-4154d7b6595c tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:30.770950 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-38279986-03ba-4803-afba-4154d7b6595c tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:20:30.780159 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-38279986-03ba-4803-afba-4154d7b6595c tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1575 microversion: 2.1 time: 0.157670 Jul 25 23:20:30.780725 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 569/1134] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:20:30 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:20:31.801950 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-a2eb3bd9-7600-49be-8c20-5d42a8b2d8ea tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:31.802544 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-a2eb3bd9-7600-49be-8c20-5d42a8b2d8ea tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:31.809432 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a2eb3bd9-7600-49be-8c20-5d42a8b2d8ea tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:31.809870 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a2eb3bd9-7600-49be-8c20-5d42a8b2d8ea tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:31.810620 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a2eb3bd9-7600-49be-8c20-5d42a8b2d8ea tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:31.811050 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a2eb3bd9-7600-49be-8c20-5d42a8b2d8ea tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:31.943484 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-a2eb3bd9-7600-49be-8c20-5d42a8b2d8ea tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:20:31.951267 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-a2eb3bd9-7600-49be-8c20-5d42a8b2d8ea tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1575 microversion: 2.1 time: 0.153126 Jul 25 23:20:31.951835 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 566/1135] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:20:31 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:20:32.972904 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-84707770-80da-44af-901e-cbe55df510c2 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:32.973547 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-84707770-80da-44af-901e-cbe55df510c2 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:32.982714 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-84707770-80da-44af-901e-cbe55df510c2 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:32.983161 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-84707770-80da-44af-901e-cbe55df510c2 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:32.983934 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-84707770-80da-44af-901e-cbe55df510c2 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:32.984367 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-84707770-80da-44af-901e-cbe55df510c2 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:33.118946 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-84707770-80da-44af-901e-cbe55df510c2 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:20:33.127160 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-84707770-80da-44af-901e-cbe55df510c2 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1575 microversion: 2.1 time: 0.158120 Jul 25 23:20:33.127718 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 570/1136] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:20:32 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:20:34.147915 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-65ea3ded-07d0-46e3-907e-a761e313e001 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:34.148545 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-65ea3ded-07d0-46e3-907e-a761e313e001 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:34.155390 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-65ea3ded-07d0-46e3-907e-a761e313e001 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:34.155839 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-65ea3ded-07d0-46e3-907e-a761e313e001 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:34.156594 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-65ea3ded-07d0-46e3-907e-a761e313e001 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:34.157024 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-65ea3ded-07d0-46e3-907e-a761e313e001 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:34.175308 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:20:34.289737 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-65ea3ded-07d0-46e3-907e-a761e313e001 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:20:34.298011 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-65ea3ded-07d0-46e3-907e-a761e313e001 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1575 microversion: 2.1 time: 0.153969 Jul 25 23:20:34.298676 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 567/1137] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:20:34 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:20:35.320972 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-f856630a-c344-4621-a7bf-35f8f701ff9a tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:35.321698 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-f856630a-c344-4621-a7bf-35f8f701ff9a tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:35.329238 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f856630a-c344-4621-a7bf-35f8f701ff9a tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:35.329691 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f856630a-c344-4621-a7bf-35f8f701ff9a tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:35.330467 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f856630a-c344-4621-a7bf-35f8f701ff9a tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:35.330903 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-f856630a-c344-4621-a7bf-35f8f701ff9a tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:35.464610 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-f856630a-c344-4621-a7bf-35f8f701ff9a tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:20:35.472396 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-f856630a-c344-4621-a7bf-35f8f701ff9a tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1575 microversion: 2.1 time: 0.155473 Jul 25 23:20:35.472974 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 571/1138] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:20:35 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:20:36.494600 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-a0d39b45-1204-4720-b766-fdc86907b063 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:36.496316 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-a0d39b45-1204-4720-b766-fdc86907b063 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:36.502913 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a0d39b45-1204-4720-b766-fdc86907b063 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:36.503356 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a0d39b45-1204-4720-b766-fdc86907b063 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:36.504113 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a0d39b45-1204-4720-b766-fdc86907b063 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:36.504541 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-a0d39b45-1204-4720-b766-fdc86907b063 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:36.643660 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-a0d39b45-1204-4720-b766-fdc86907b063 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:20:36.651382 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-a0d39b45-1204-4720-b766-fdc86907b063 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1575 microversion: 2.1 time: 0.160553 Jul 25 23:20:36.652160 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 568/1139] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:20:36 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:20:37.671959 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-6a72b412-cf9f-42fd-8c99-f72f0db347d7 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:37.672557 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-6a72b412-cf9f-42fd-8c99-f72f0db347d7 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:37.675008 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=29 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:20:37.679851 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6a72b412-cf9f-42fd-8c99-f72f0db347d7 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:37.680295 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6a72b412-cf9f-42fd-8c99-f72f0db347d7 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:37.681065 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6a72b412-cf9f-42fd-8c99-f72f0db347d7 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:37.681515 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-6a72b412-cf9f-42fd-8c99-f72f0db347d7 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:37.685674 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=81 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:20:37.818809 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-6a72b412-cf9f-42fd-8c99-f72f0db347d7 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:20:37.829481 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-6a72b412-cf9f-42fd-8c99-f72f0db347d7 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1575 microversion: 2.1 time: 0.160912 Jul 25 23:20:37.830118 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 572/1140] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:20:37 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:20:38.851270 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-69ab8b52-c40f-44e3-96fc-570825314ae3 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:38.851814 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-69ab8b52-c40f-44e3-96fc-570825314ae3 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:38.854796 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_api:SELECT=33 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:20:38.859783 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-69ab8b52-c40f-44e3-96fc-570825314ae3 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:38.860548 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-69ab8b52-c40f-44e3-96fc-570825314ae3 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:38.860980 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-69ab8b52-c40f-44e3-96fc-570825314ae3 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:38.861442 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-69ab8b52-c40f-44e3-96fc-570825314ae3 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:38.994109 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-69ab8b52-c40f-44e3-96fc-570825314ae3 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:20:39.001798 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-69ab8b52-c40f-44e3-96fc-570825314ae3 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1575 microversion: 2.1 time: 0.154535 Jul 25 23:20:39.002360 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 569/1141] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:20:38 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:20:39.720455 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-f17bebbb-5d6a-4c4f-b8a1-9e37ce7e724b req-3c2b1c05-4509-40e3-b917-edb66f5081d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aef45a51-92a9-46be-8adf-5d7d259dbe28", "name": "network-vif-plugged", "status": "completed", "tag": "0ea01c9b-495f-4404-af19-caa8c31834e3"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:20:39.731165 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-f17bebbb-5d6a-4c4f-b8a1-9e37ce7e724b req-3c2b1c05-4509-40e3-b917-edb66f5081d4 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:39.731606 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-f17bebbb-5d6a-4c4f-b8a1-9e37ce7e724b req-3c2b1c05-4509-40e3-b917-edb66f5081d4 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:39.742679 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-f17bebbb-5d6a-4c4f-b8a1-9e37ce7e724b req-3c2b1c05-4509-40e3-b917-edb66f5081d4 service nova] Creating event network-vif-plugged:0ea01c9b-495f-4404-af19-caa8c31834e3 for instance aef45a51-92a9-46be-8adf-5d7d259dbe28 on hv-cinder-79760 Jul 25 23:20:39.748628 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-f17bebbb-5d6a-4c4f-b8a1-9e37ce7e724b req-3c2b1c05-4509-40e3-b917-edb66f5081d4 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032353 Jul 25 23:20:39.749242 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 573/1142] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:20:40.023602 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-f24a879b-4915-4dfd-bd08-3651097a5b0b tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:40.024231 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-f24a879b-4915-4dfd-bd08-3651097a5b0b tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:40.032326 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f24a879b-4915-4dfd-bd08-3651097a5b0b tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:40.032782 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f24a879b-4915-4dfd-bd08-3651097a5b0b tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:40.033651 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f24a879b-4915-4dfd-bd08-3651097a5b0b tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:40.034090 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f24a879b-4915-4dfd-bd08-3651097a5b0b tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:40.214899 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-f24a879b-4915-4dfd-bd08-3651097a5b0b tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:20:40.222998 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-f24a879b-4915-4dfd-bd08-3651097a5b0b tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1575 microversion: 2.1 time: 0.203703 Jul 25 23:20:40.227297 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 570/1143] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:20:40 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1575 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:20:41.246387 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-476300a6-c054-4a72-8f5d-b4f3f2e3e6e5 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:41.246998 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-476300a6-c054-4a72-8f5d-b4f3f2e3e6e5 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:41.253977 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-476300a6-c054-4a72-8f5d-b4f3f2e3e6e5 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:41.254432 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-476300a6-c054-4a72-8f5d-b4f3f2e3e6e5 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:41.255205 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-476300a6-c054-4a72-8f5d-b4f3f2e3e6e5 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:41.255647 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-476300a6-c054-4a72-8f5d-b4f3f2e3e6e5 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:41.388404 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-476300a6-c054-4a72-8f5d-b4f3f2e3e6e5 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:20:41.396098 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-476300a6-c054-4a72-8f5d-b4f3f2e3e6e5 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1575 microversion: 2.1 time: 0.154347 Jul 25 23:20:41.396662 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 574/1144] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:20:41 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:20:42.419254 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-6f551cae-f6c9-4cd8-8491-8529d2bf67e2 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:42.419913 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-6f551cae-f6c9-4cd8-8491-8529d2bf67e2 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:42.426459 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6f551cae-f6c9-4cd8-8491-8529d2bf67e2 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:42.426898 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6f551cae-f6c9-4cd8-8491-8529d2bf67e2 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:42.427657 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6f551cae-f6c9-4cd8-8491-8529d2bf67e2 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:42.428126 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-6f551cae-f6c9-4cd8-8491-8529d2bf67e2 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:42.561059 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-6f551cae-f6c9-4cd8-8491-8529d2bf67e2 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:20:42.568506 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-6f551cae-f6c9-4cd8-8491-8529d2bf67e2 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1562 microversion: 2.1 time: 0.154422 Jul 25 23:20:42.569063 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 571/1145] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:20:42 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:20:45.242887 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 23:20:45.243472 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Mon Jul 25 23:20:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 23:20:49.389545 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 23:20:49.390270 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Mon Jul 25 23:20:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 23:20:54.488989 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-b0b2f677-98ff-4ee0-8d20-d04adf176210 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:54.489725 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b0b2f677-98ff-4ee0-8d20-d04adf176210 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: 4b7c733d-fad0-4aca-8d80-3f5e1f1987bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:54.490939 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_api:SELECT=5 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:20:54.494044 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=26 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:20:54.503594 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=5 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:20:54.504353 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=13 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:20:54.506164 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b0b2f677-98ff-4ee0-8d20-d04adf176210 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:54.513191 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b0b2f677-98ff-4ee0-8d20-d04adf176210 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:54.513191 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b0b2f677-98ff-4ee0-8d20-d04adf176210 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:54.513191 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-b0b2f677-98ff-4ee0-8d20-d04adf176210 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:54.542446 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-b0b2f677-98ff-4ee0-8d20-d04adf176210 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: 4b7c733d-fad0-4aca-8d80-3f5e1f1987bf] Going to try to terminate instance {{(pid=118410) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 23:20:54.557382 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-0de16469-ffed-47f3-996a-7ccff5ffcac2 req-75a13740-6e21-484d-a1f6-cf189d5a94ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b7c733d-fad0-4aca-8d80-3f5e1f1987bf", "tag": "dd8cf6ea-f52b-4736-a385-d5445fecee2c"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:20:54.568740 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-0de16469-ffed-47f3-996a-7ccff5ffcac2 req-75a13740-6e21-484d-a1f6-cf189d5a94ab service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:54.569634 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-0de16469-ffed-47f3-996a-7ccff5ffcac2 req-75a13740-6e21-484d-a1f6-cf189d5a94ab service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:54.582873 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-0de16469-ffed-47f3-996a-7ccff5ffcac2 req-75a13740-6e21-484d-a1f6-cf189d5a94ab service nova] Creating event network-changed:dd8cf6ea-f52b-4736-a385-d5445fecee2c for instance 4b7c733d-fad0-4aca-8d80-3f5e1f1987bf on hv-cinder-79760 Jul 25 23:20:54.589264 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-0de16469-ffed-47f3-996a-7ccff5ffcac2 req-75a13740-6e21-484d-a1f6-cf189d5a94ab service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107489 Jul 25 23:20:54.590967 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 572/1146] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:20:54.890088 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-b0b2f677-98ff-4ee0-8d20-d04adf176210 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "DELETE /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf" status: 204 len: 0 microversion: 2.1 time: 0.411044 Jul 25 23:20:54.890684 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 575/1147] 10.222.0.55 () {58 vars in 1239 bytes} [Mon Jul 25 23:20:54 2022] DELETE /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 23:20:54.906757 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-4900e6a2-0163-4e04-a173-0d0a7055b34d tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:54.907544 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-4900e6a2-0163-4e04-a173-0d0a7055b34d tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: 4b7c733d-fad0-4aca-8d80-3f5e1f1987bf] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:54.914406 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4900e6a2-0163-4e04-a173-0d0a7055b34d tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:54.915138 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4900e6a2-0163-4e04-a173-0d0a7055b34d tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:54.916100 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4900e6a2-0163-4e04-a173-0d0a7055b34d tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:54.916532 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-4900e6a2-0163-4e04-a173-0d0a7055b34d tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:55.064339 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-4900e6a2-0163-4e04-a173-0d0a7055b34d tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:20:55.075308 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-4900e6a2-0163-4e04-a173-0d0a7055b34d tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf" status: 200 len: 1574 microversion: 2.1 time: 0.179126 Jul 25 23:20:55.076074 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 573/1148] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:20:54 2022] GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf => generated 1574 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:20:56.098008 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-8f565781-0019-44ee-8d7a-730bf31cde3d tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:56.098701 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-8f565781-0019-44ee-8d7a-730bf31cde3d tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: 4b7c733d-fad0-4aca-8d80-3f5e1f1987bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:56.105199 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8f565781-0019-44ee-8d7a-730bf31cde3d tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:56.105694 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8f565781-0019-44ee-8d7a-730bf31cde3d tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:56.106701 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8f565781-0019-44ee-8d7a-730bf31cde3d tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:56.107020 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-8f565781-0019-44ee-8d7a-730bf31cde3d tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:56.254335 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-8f565781-0019-44ee-8d7a-730bf31cde3d tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:20:56.263399 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-8f565781-0019-44ee-8d7a-730bf31cde3d tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf" status: 200 len: 1574 microversion: 2.1 time: 0.169637 Jul 25 23:20:56.264057 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 576/1149] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:20:56 2022] GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:20:57.202498 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-e60b232f-96d6-400c-9a84-e65470ddce02 req-587084c1-b7c5-4555-9ab9-1da98395609a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b7c733d-fad0-4aca-8d80-3f5e1f1987bf", "name": "network-vif-deleted", "tag": "dd8cf6ea-f52b-4736-a385-d5445fecee2c"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:20:57.212345 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-e60b232f-96d6-400c-9a84-e65470ddce02 req-587084c1-b7c5-4555-9ab9-1da98395609a service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:57.216826 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-e60b232f-96d6-400c-9a84-e65470ddce02 req-587084c1-b7c5-4555-9ab9-1da98395609a service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:57.224047 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-e60b232f-96d6-400c-9a84-e65470ddce02 req-587084c1-b7c5-4555-9ab9-1da98395609a service nova] Creating event network-vif-deleted:dd8cf6ea-f52b-4736-a385-d5445fecee2c for instance 4b7c733d-fad0-4aca-8d80-3f5e1f1987bf on hv-cinder-79760 Jul 25 23:20:57.229077 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-e60b232f-96d6-400c-9a84-e65470ddce02 req-587084c1-b7c5-4555-9ab9-1da98395609a service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030482 Jul 25 23:20:57.229709 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 574/1150] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:20:57.285604 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-29f90882-a7fb-4a82-9d20-2746823c8b5e tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:57.286215 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-29f90882-a7fb-4a82-9d20-2746823c8b5e tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: 4b7c733d-fad0-4aca-8d80-3f5e1f1987bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:57.292949 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-29f90882-a7fb-4a82-9d20-2746823c8b5e tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:57.294170 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-29f90882-a7fb-4a82-9d20-2746823c8b5e tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:57.294917 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-29f90882-a7fb-4a82-9d20-2746823c8b5e tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:57.295351 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-29f90882-a7fb-4a82-9d20-2746823c8b5e tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:57.362102 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-29f90882-a7fb-4a82-9d20-2746823c8b5e tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:20:57.370087 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-29f90882-a7fb-4a82-9d20-2746823c8b5e tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf" status: 200 len: 1389 microversion: 2.1 time: 0.088525 Jul 25 23:20:57.370573 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 577/1151] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:20:57 2022] GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf => generated 1389 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:20:58.392832 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-858edb53-9a00-4c62-8e45-4becb038dbee tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:58.393541 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-858edb53-9a00-4c62-8e45-4becb038dbee tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: 4b7c733d-fad0-4aca-8d80-3f5e1f1987bf] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:58.399917 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-858edb53-9a00-4c62-8e45-4becb038dbee tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:58.400358 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-858edb53-9a00-4c62-8e45-4becb038dbee tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:58.401183 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-858edb53-9a00-4c62-8e45-4becb038dbee tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:58.401611 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-858edb53-9a00-4c62-8e45-4becb038dbee tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:58.439465 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-858edb53-9a00-4c62-8e45-4becb038dbee tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:58.439886 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-858edb53-9a00-4c62-8e45-4becb038dbee tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:58.440342 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.objects.instance [None req-858edb53-9a00-4c62-8e45-4becb038dbee tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lazy-loading 'fault' on Instance uuid 4b7c733d-fad0-4aca-8d80-3f5e1f1987bf {{(pid=118409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 23:20:58.484770 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-858edb53-9a00-4c62-8e45-4becb038dbee tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:20:58.492314 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-858edb53-9a00-4c62-8e45-4becb038dbee tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf" status: 200 len: 1229 microversion: 2.1 time: 0.105053 Jul 25 23:20:58.492888 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 575/1152] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:20:58 2022] GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf => generated 1229 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:20:59.515133 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c6debeaf-4126-4bf0-85aa-fd1ab232d8f9 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:20:59.515744 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-c6debeaf-4126-4bf0-85aa-fd1ab232d8f9 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: 4b7c733d-fad0-4aca-8d80-3f5e1f1987bf] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:20:59.522597 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c6debeaf-4126-4bf0-85aa-fd1ab232d8f9 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:59.523046 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c6debeaf-4126-4bf0-85aa-fd1ab232d8f9 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:59.523822 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c6debeaf-4126-4bf0-85aa-fd1ab232d8f9 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:20:59.524253 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-c6debeaf-4126-4bf0-85aa-fd1ab232d8f9 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:20:59.539186 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-c6debeaf-4126-4bf0-85aa-fd1ab232d8f9 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] HTTP exception thrown: Instance 4b7c733d-fad0-4aca-8d80-3f5e1f1987bf could not be found. Jul 25 23:20:59.540853 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c6debeaf-4126-4bf0-85aa-fd1ab232d8f9 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Request method failure captured: Jul 25 23:20:59.540853 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: request: GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf HTTP/1.1 Jul 25 23:20:59.540853 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 25 23:20:59.540853 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 25 23:20:59.540853 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Connection: close Jul 25 23:20:59.540853 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 25 23:20:59.540853 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 25 23:20:59.540853 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Host: 10.222.0.55 Jul 25 23:20:59.540853 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 25 23:20:59.540853 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.10 Jul 25 23:20:59.540853 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABi3yPG_u6_VIlihooKP8ZYQokhoS8GVUA0c86aUw25vcv8StYqyh7P0MN5QPq8YHO5d5GVLyacWhqkguKxp-vluVaTPxynyU_BQw2_CDzcgH5Mz4DtdjfsldpGIwM8M2pES1x7Wekfa5dHqLyZ_m7TKxxDAFFrGTrh5_B42jrppfOaWCU Jul 25 23:20:59.540853 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 25 23:20:59.540853 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 25 23:20:59.540853 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 25 23:20:59.540853 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 25 23:20:59.540853 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 25 23:20:59.540853 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 25 23:20:59.540853 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Id: f661a74731894c6e94eced8d8f7520e7 Jul 25 23:20:59.540853 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-TestVolumeBootPattern-1273322900 Jul 25 23:20:59.540853 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Role: reader,member Jul 25 23:20:59.540853 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Roles: reader,member Jul 25 23:20:59.542677 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f661a74731894c6e94eced8d8f7520e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f661a74731894c6e94eced8d8f7520e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f661a74731894c6e94eced8d8f7520e7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f661a74731894c6e94eced8d8f7520e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:20:59.542677 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-TestVolumeBootPattern-1273322900 Jul 25 23:20:59.542677 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Id: f661a74731894c6e94eced8d8f7520e7 Jul 25 23:20:59.542677 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-TestVolumeBootPattern-1273322900 Jul 25 23:20:59.542677 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User: tempest-TestVolumeBootPattern-1273322900-project Jul 25 23:20:59.542677 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 25 23:20:59.542677 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 25 23:20:59.542677 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Id: c862a035745641b5a8dde92a3d570b35 Jul 25 23:20:59.542677 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-TestVolumeBootPattern-1273322900-project Jul 25 23:20:59.542677 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: method: > Jul 25 23:20:59.542677 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: exception: Instance 4b7c733d-fad0-4aca-8d80-3f5e1f1987bf could not be found. Jul 25 23:20:59.542677 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: action_args: {'id': '4b7c733d-fad0-4aca-8d80-3f5e1f1987bf'} Jul 25 23:20:59.545178 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:20:59.545178 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:20:59.545178 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:20:59.545178 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:20:59.545178 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:20:59.545178 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:20:59.545178 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:20:59.545178 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:20:59.545178 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:20:59.545178 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:20:59.545178 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b7c733d-fad0-4aca-8d80-3f5e1f1987bf could not be found. Jul 25 23:20:59.545178 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:20:59.545178 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:20:59.545178 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:20:59.545178 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:20:59.545178 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:20:59.545178 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:20:59.545178 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:20:59.545178 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:20:59.545178 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:20:59.546896 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:20:59.546896 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 23:20:59.546896 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 23:20:59.546896 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:20:59.546896 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:20:59.546896 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:20:59.546896 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:20:59.546896 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b7c733d-fad0-4aca-8d80-3f5e1f1987bf could not be found. Jul 25 23:20:59.546896 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:20:59.546896 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:20:59.546896 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:20:59.546896 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:20:59.546896 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:20:59.546896 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:20:59.546896 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:20:59.546896 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:20:59.546896 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b7c733d-fad0-4aca-8d80-3f5e1f1987bf could not be found. Jul 25 23:20:59.546896 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:20:59.548364 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c6debeaf-4126-4bf0-85aa-fd1ab232d8f9 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Returning 404 to user: Instance 4b7c733d-fad0-4aca-8d80-3f5e1f1987bf could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:20:59.548364 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c6debeaf-4126-4bf0-85aa-fd1ab232d8f9 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf" status: 404 len: 111 microversion: 2.1 time: 0.031355 Jul 25 23:20:59.548364 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 578/1153] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:20:59 2022] GET /compute/v2.1/servers/4b7c733d-fad0-4aca-8d80-3f5e1f1987bf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:21:02.978943 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-9d2aa241-47ad-443a-bda1-532db951852c tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:21:02.978943 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-9d2aa241-47ad-443a-bda1-532db951852c tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: c2d4d668-a1e5-4c5c-9135-567e0a05bfe0] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:21:02.981045 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-951906d5-1643-4311-85da-f92321ead21a req-96f5bfa0-1ff6-4cf1-9f45-6e372a882a3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2d4d668-a1e5-4c5c-9135-567e0a05bfe0", "tag": "aecda5bb-f585-4d61-a56d-4134bf0e379b"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:21:02.985962 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9d2aa241-47ad-443a-bda1-532db951852c tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:21:02.986792 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9d2aa241-47ad-443a-bda1-532db951852c tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:21:02.987608 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9d2aa241-47ad-443a-bda1-532db951852c tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:21:02.988005 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-9d2aa241-47ad-443a-bda1-532db951852c tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:21:02.992028 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-951906d5-1643-4311-85da-f92321ead21a req-96f5bfa0-1ff6-4cf1-9f45-6e372a882a3c service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:21:02.992460 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-951906d5-1643-4311-85da-f92321ead21a req-96f5bfa0-1ff6-4cf1-9f45-6e372a882a3c service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:21:03.005373 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-951906d5-1643-4311-85da-f92321ead21a req-96f5bfa0-1ff6-4cf1-9f45-6e372a882a3c service nova] Creating event network-changed:aecda5bb-f585-4d61-a56d-4134bf0e379b for instance c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 on hv-cinder-79760 Jul 25 23:21:03.011178 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-951906d5-1643-4311-85da-f92321ead21a req-96f5bfa0-1ff6-4cf1-9f45-6e372a882a3c service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034190 Jul 25 23:21:03.012267 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 579/1154] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:21:03.019691 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-9d2aa241-47ad-443a-bda1-532db951852c tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: c2d4d668-a1e5-4c5c-9135-567e0a05bfe0] Going to try to terminate instance {{(pid=118409) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 23:21:03.329600 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-9d2aa241-47ad-443a-bda1-532db951852c tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "DELETE /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0" status: 204 len: 0 microversion: 2.1 time: 0.355351 Jul 25 23:21:03.335087 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 576/1155] 10.222.0.55 () {58 vars in 1239 bytes} [Mon Jul 25 23:21:02 2022] DELETE /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 23:21:03.340203 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-13322da2-3d0a-4991-941c-0b23d86be5a5 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:21:03.341215 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-13322da2-3d0a-4991-941c-0b23d86be5a5 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: c2d4d668-a1e5-4c5c-9135-567e0a05bfe0] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:21:03.348213 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-13322da2-3d0a-4991-941c-0b23d86be5a5 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:21:03.348978 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-13322da2-3d0a-4991-941c-0b23d86be5a5 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:21:03.349835 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-13322da2-3d0a-4991-941c-0b23d86be5a5 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:21:03.350445 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-13322da2-3d0a-4991-941c-0b23d86be5a5 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:21:03.496802 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-13322da2-3d0a-4991-941c-0b23d86be5a5 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:21:03.505734 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-13322da2-3d0a-4991-941c-0b23d86be5a5 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0" status: 200 len: 1577 microversion: 2.1 time: 0.169657 Jul 25 23:21:03.506643 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 580/1156] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:21:03 2022] GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 25 23:21:04.528752 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-632919e0-decb-4a67-98a0-cea1e4778547 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:21:04.530226 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-632919e0-decb-4a67-98a0-cea1e4778547 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: c2d4d668-a1e5-4c5c-9135-567e0a05bfe0] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:21:04.537233 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-632919e0-decb-4a67-98a0-cea1e4778547 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:21:04.537686 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-632919e0-decb-4a67-98a0-cea1e4778547 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:21:04.538483 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-632919e0-decb-4a67-98a0-cea1e4778547 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:21:04.538920 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-632919e0-decb-4a67-98a0-cea1e4778547 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:21:04.679092 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-632919e0-decb-4a67-98a0-cea1e4778547 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:21:04.688310 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-632919e0-decb-4a67-98a0-cea1e4778547 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0" status: 200 len: 1577 microversion: 2.1 time: 0.163807 Jul 25 23:21:04.688897 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 577/1157] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:21:04 2022] GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:21:05.642773 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-f974bbb4-946d-4eb5-b237-9de1fe3133af req-79b7eefa-f00f-46fe-8ea8-e02e7bac357f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2d4d668-a1e5-4c5c-9135-567e0a05bfe0", "name": "network-vif-deleted", "tag": "aecda5bb-f585-4d61-a56d-4134bf0e379b"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:21:05.652791 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-f974bbb4-946d-4eb5-b237-9de1fe3133af req-79b7eefa-f00f-46fe-8ea8-e02e7bac357f service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:21:05.653276 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-f974bbb4-946d-4eb5-b237-9de1fe3133af req-79b7eefa-f00f-46fe-8ea8-e02e7bac357f service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:21:05.665596 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-f974bbb4-946d-4eb5-b237-9de1fe3133af req-79b7eefa-f00f-46fe-8ea8-e02e7bac357f service nova] Creating event network-vif-deleted:aecda5bb-f585-4d61-a56d-4134bf0e379b for instance c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 on hv-cinder-79760 Jul 25 23:21:05.671152 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-f974bbb4-946d-4eb5-b237-9de1fe3133af req-79b7eefa-f00f-46fe-8ea8-e02e7bac357f service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031961 Jul 25 23:21:05.671756 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 581/1158] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:21:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:21:05.712305 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-f73b7dc0-7e67-40dd-9d5b-2b68e6adfc01 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:21:05.712974 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-f73b7dc0-7e67-40dd-9d5b-2b68e6adfc01 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: c2d4d668-a1e5-4c5c-9135-567e0a05bfe0] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:21:05.721081 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f73b7dc0-7e67-40dd-9d5b-2b68e6adfc01 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:21:05.724468 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f73b7dc0-7e67-40dd-9d5b-2b68e6adfc01 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:21:05.724468 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f73b7dc0-7e67-40dd-9d5b-2b68e6adfc01 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:21:05.724468 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-f73b7dc0-7e67-40dd-9d5b-2b68e6adfc01 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:21:05.793596 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-f73b7dc0-7e67-40dd-9d5b-2b68e6adfc01 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:21:05.801347 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-f73b7dc0-7e67-40dd-9d5b-2b68e6adfc01 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0" status: 200 len: 1391 microversion: 2.1 time: 0.093943 Jul 25 23:21:05.801841 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 578/1159] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:21:05 2022] GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 => generated 1391 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:21:06.825504 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-3e227349-872b-4ea0-8c85-0fdbfd080026 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:21:06.826869 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-3e227349-872b-4ea0-8c85-0fdbfd080026 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: c2d4d668-a1e5-4c5c-9135-567e0a05bfe0] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:21:06.833339 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3e227349-872b-4ea0-8c85-0fdbfd080026 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:21:06.833710 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3e227349-872b-4ea0-8c85-0fdbfd080026 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:21:06.834492 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3e227349-872b-4ea0-8c85-0fdbfd080026 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:21:06.834922 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3e227349-872b-4ea0-8c85-0fdbfd080026 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:21:06.871635 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3e227349-872b-4ea0-8c85-0fdbfd080026 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:21:06.872104 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3e227349-872b-4ea0-8c85-0fdbfd080026 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:21:06.872525 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.objects.instance [None req-3e227349-872b-4ea0-8c85-0fdbfd080026 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lazy-loading 'fault' on Instance uuid c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 {{(pid=118410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 23:21:06.916122 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-3e227349-872b-4ea0-8c85-0fdbfd080026 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c862a035745641b5a8dde92a3d570b35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f661a74731894c6e94eced8d8f7520e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:21:06.923857 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-3e227349-872b-4ea0-8c85-0fdbfd080026 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0" status: 200 len: 1230 microversion: 2.1 time: 0.104720 Jul 25 23:21:06.924436 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 582/1160] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:21:06 2022] GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 => generated 1230 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:21:07.953035 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-ce7c6c6e-f422-459c-a1bd-b868b3781903 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:21:07.953660 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-ce7c6c6e-f422-459c-a1bd-b868b3781903 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: c2d4d668-a1e5-4c5c-9135-567e0a05bfe0] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:21:07.960497 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ce7c6c6e-f422-459c-a1bd-b868b3781903 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:21:07.960936 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ce7c6c6e-f422-459c-a1bd-b868b3781903 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:21:07.961741 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ce7c6c6e-f422-459c-a1bd-b868b3781903 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:21:07.962177 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-ce7c6c6e-f422-459c-a1bd-b868b3781903 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:21:07.977576 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.wsgi [None req-ce7c6c6e-f422-459c-a1bd-b868b3781903 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] HTTP exception thrown: Instance c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 could not be found. Jul 25 23:21:07.979281 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-ce7c6c6e-f422-459c-a1bd-b868b3781903 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Request method failure captured: Jul 25 23:21:07.979281 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: request: GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 HTTP/1.1 Jul 25 23:21:07.979281 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept: application/json Jul 25 23:21:07.979281 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept-Encoding: identity Jul 25 23:21:07.979281 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Connection: close Jul 25 23:21:07.979281 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Length: 0 Jul 25 23:21:07.979281 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Type: application/json Jul 25 23:21:07.979281 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Host: 10.222.0.55 Jul 25 23:21:07.979281 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Openstack-System-Scope: None Jul 25 23:21:07.979281 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: User-Agent: python-urllib3/1.26.10 Jul 25 23:21:07.979281 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Auth-Token: gAAAAABi3yPG_u6_VIlihooKP8ZYQokhoS8GVUA0c86aUw25vcv8StYqyh7P0MN5QPq8YHO5d5GVLyacWhqkguKxp-vluVaTPxynyU_BQw2_CDzcgH5Mz4DtdjfsldpGIwM8M2pES1x7Wekfa5dHqLyZ_m7TKxxDAFFrGTrh5_B42jrppfOaWCU Jul 25 23:21:07.979281 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Id: None Jul 25 23:21:07.979281 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Name: None Jul 25 23:21:07.979281 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Identity-Status: Confirmed Jul 25 23:21:07.979281 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Is-Admin-Project: True Jul 25 23:21:07.979281 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Id: default Jul 25 23:21:07.979281 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Name: Default Jul 25 23:21:07.979281 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Id: f661a74731894c6e94eced8d8f7520e7 Jul 25 23:21:07.979281 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Name: tempest-TestVolumeBootPattern-1273322900 Jul 25 23:21:07.979281 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Role: reader,member Jul 25 23:21:07.979281 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Roles: reader,member Jul 25 23:21:07.980841 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f661a74731894c6e94eced8d8f7520e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f661a74731894c6e94eced8d8f7520e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f661a74731894c6e94eced8d8f7520e7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f661a74731894c6e94eced8d8f7520e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:21:07.980841 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant: tempest-TestVolumeBootPattern-1273322900 Jul 25 23:21:07.980841 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Id: f661a74731894c6e94eced8d8f7520e7 Jul 25 23:21:07.980841 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Name: tempest-TestVolumeBootPattern-1273322900 Jul 25 23:21:07.980841 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User: tempest-TestVolumeBootPattern-1273322900-project Jul 25 23:21:07.980841 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Id: default Jul 25 23:21:07.980841 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Name: Default Jul 25 23:21:07.980841 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Id: c862a035745641b5a8dde92a3d570b35 Jul 25 23:21:07.980841 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Name: tempest-TestVolumeBootPattern-1273322900-project Jul 25 23:21:07.980841 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: method: > Jul 25 23:21:07.980841 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: exception: Instance c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 could not be found. Jul 25 23:21:07.980841 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: action_args: {'id': 'c2d4d668-a1e5-4c5c-9135-567e0a05bfe0'} Jul 25 23:21:07.981750 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:21:07.981750 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:21:07.981750 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:21:07.981750 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:21:07.981750 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:21:07.981750 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:21:07.981750 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:21:07.981750 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:21:07.981750 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:21:07.981750 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:21:07.981750 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 could not be found. Jul 25 23:21:07.981750 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:21:07.981750 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:21:07.981750 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:21:07.981750 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:21:07.981750 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:21:07.981750 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:21:07.981750 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:21:07.981750 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:21:07.981750 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:21:07.983774 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:21:07.983774 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 23:21:07.983774 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 23:21:07.983774 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:21:07.983774 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:21:07.983774 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:21:07.983774 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:21:07.983774 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 could not be found. Jul 25 23:21:07.983774 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:21:07.983774 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:21:07.983774 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:21:07.983774 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:21:07.983774 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:21:07.983774 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:21:07.983774 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:21:07.983774 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:21:07.983774 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 could not be found. Jul 25 23:21:07.983774 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:21:07.984997 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-ce7c6c6e-f422-459c-a1bd-b868b3781903 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Returning 404 to user: Instance c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 could not be found. {{(pid=118409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:21:07.984997 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-ce7c6c6e-f422-459c-a1bd-b868b3781903 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0" status: 404 len: 111 microversion: 2.1 time: 0.031512 Jul 25 23:21:07.984997 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 579/1161] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:21:07 2022] GET /compute/v2.1/servers/c2d4d668-a1e5-4c5c-9135-567e0a05bfe0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 25 23:21:08.557710 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-3a17985f-e772-4403-9f76-467142d3ccae tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:21:08.558361 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-3a17985f-e772-4403-9f76-467142d3ccae tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: f900a476-26ad-48ba-95f9-eb96fa8b9dbe] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:21:08.565171 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3a17985f-e772-4403-9f76-467142d3ccae tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:21:08.565615 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3a17985f-e772-4403-9f76-467142d3ccae tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:21:08.566374 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3a17985f-e772-4403-9f76-467142d3ccae tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:21:08.566799 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-3a17985f-e772-4403-9f76-467142d3ccae tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:21:08.580388 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.wsgi [None req-3a17985f-e772-4403-9f76-467142d3ccae tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] HTTP exception thrown: Instance f900a476-26ad-48ba-95f9-eb96fa8b9dbe could not be found. Jul 25 23:21:08.582064 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-3a17985f-e772-4403-9f76-467142d3ccae tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Request method failure captured: Jul 25 23:21:08.582064 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: request: DELETE /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe HTTP/1.1 Jul 25 23:21:08.582064 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept: application/json Jul 25 23:21:08.582064 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Accept-Encoding: identity Jul 25 23:21:08.582064 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Connection: close Jul 25 23:21:08.582064 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Length: 0 Jul 25 23:21:08.582064 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Content-Type: application/json Jul 25 23:21:08.582064 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Host: 10.222.0.55 Jul 25 23:21:08.582064 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Openstack-System-Scope: None Jul 25 23:21:08.582064 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: User-Agent: python-urllib3/1.26.10 Jul 25 23:21:08.582064 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Auth-Token: gAAAAABi3yPG_u6_VIlihooKP8ZYQokhoS8GVUA0c86aUw25vcv8StYqyh7P0MN5QPq8YHO5d5GVLyacWhqkguKxp-vluVaTPxynyU_BQw2_CDzcgH5Mz4DtdjfsldpGIwM8M2pES1x7Wekfa5dHqLyZ_m7TKxxDAFFrGTrh5_B42jrppfOaWCU Jul 25 23:21:08.582064 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Id: None Jul 25 23:21:08.582064 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Domain-Name: None Jul 25 23:21:08.582064 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Identity-Status: Confirmed Jul 25 23:21:08.582064 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Is-Admin-Project: True Jul 25 23:21:08.582064 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Id: default Jul 25 23:21:08.582064 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Domain-Name: Default Jul 25 23:21:08.582064 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Id: f661a74731894c6e94eced8d8f7520e7 Jul 25 23:21:08.582064 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Project-Name: tempest-TestVolumeBootPattern-1273322900 Jul 25 23:21:08.582064 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Role: reader,member Jul 25 23:21:08.582064 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Roles: reader,member Jul 25 23:21:08.583758 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f661a74731894c6e94eced8d8f7520e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f661a74731894c6e94eced8d8f7520e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f661a74731894c6e94eced8d8f7520e7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f661a74731894c6e94eced8d8f7520e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:21:08.583758 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant: tempest-TestVolumeBootPattern-1273322900 Jul 25 23:21:08.583758 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Id: f661a74731894c6e94eced8d8f7520e7 Jul 25 23:21:08.583758 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-Tenant-Name: tempest-TestVolumeBootPattern-1273322900 Jul 25 23:21:08.583758 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User: tempest-TestVolumeBootPattern-1273322900-project Jul 25 23:21:08.583758 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Id: default Jul 25 23:21:08.583758 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Domain-Name: Default Jul 25 23:21:08.583758 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Id: c862a035745641b5a8dde92a3d570b35 Jul 25 23:21:08.583758 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: X-User-Name: tempest-TestVolumeBootPattern-1273322900-project Jul 25 23:21:08.583758 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: method: > Jul 25 23:21:08.583758 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: exception: Instance f900a476-26ad-48ba-95f9-eb96fa8b9dbe could not be found. Jul 25 23:21:08.583758 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: action_args: {'id': 'f900a476-26ad-48ba-95f9-eb96fa8b9dbe'} Jul 25 23:21:08.584772 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:21:08.584772 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:21:08.584772 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:21:08.584772 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:21:08.584772 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:21:08.584772 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:21:08.584772 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:21:08.584772 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:21:08.584772 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:21:08.584772 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:21:08.584772 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f900a476-26ad-48ba-95f9-eb96fa8b9dbe could not be found. Jul 25 23:21:08.584772 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:21:08.584772 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:21:08.584772 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:21:08.584772 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:21:08.584772 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:21:08.584772 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:21:08.584772 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:21:08.584772 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:21:08.584772 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:21:08.586611 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:21:08.586611 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 25 23:21:08.586611 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 25 23:21:08.586611 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 25 23:21:08.586611 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 25 23:21:08.586611 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:21:08.586611 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:21:08.586611 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:21:08.586611 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:21:08.586611 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f900a476-26ad-48ba-95f9-eb96fa8b9dbe could not be found. Jul 25 23:21:08.586611 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:21:08.586611 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:21:08.586611 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:21:08.586611 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:21:08.586611 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:21:08.586611 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:21:08.586611 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:21:08.586611 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:21:08.586611 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f900a476-26ad-48ba-95f9-eb96fa8b9dbe could not be found. Jul 25 23:21:08.586611 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: ERROR nova.api.openstack.wsgi Jul 25 23:21:08.588321 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-3a17985f-e772-4403-9f76-467142d3ccae tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Returning 404 to user: Instance f900a476-26ad-48ba-95f9-eb96fa8b9dbe could not be found. {{(pid=118410) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:21:08.588321 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-3a17985f-e772-4403-9f76-467142d3ccae tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "DELETE /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe" status: 404 len: 111 microversion: 2.1 time: 0.029589 Jul 25 23:21:08.588321 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 583/1162] 10.222.0.55 () {58 vars in 1239 bytes} [Mon Jul 25 23:21:08 2022] DELETE /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:21:08.592664 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-2825a6cb-b6b1-4e3f-9b78-825115eab4f6 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:21:08.593357 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-2825a6cb-b6b1-4e3f-9b78-825115eab4f6 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] [instance: f900a476-26ad-48ba-95f9-eb96fa8b9dbe] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:21:08.599509 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2825a6cb-b6b1-4e3f-9b78-825115eab4f6 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:21:08.599947 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2825a6cb-b6b1-4e3f-9b78-825115eab4f6 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:21:08.600708 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2825a6cb-b6b1-4e3f-9b78-825115eab4f6 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:21:08.601156 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-2825a6cb-b6b1-4e3f-9b78-825115eab4f6 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:21:08.617791 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.wsgi [None req-2825a6cb-b6b1-4e3f-9b78-825115eab4f6 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] HTTP exception thrown: Instance f900a476-26ad-48ba-95f9-eb96fa8b9dbe could not be found. Jul 25 23:21:08.619404 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-2825a6cb-b6b1-4e3f-9b78-825115eab4f6 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Request method failure captured: Jul 25 23:21:08.619404 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: request: GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe HTTP/1.1 Jul 25 23:21:08.619404 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept: application/json Jul 25 23:21:08.619404 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept-Encoding: identity Jul 25 23:21:08.619404 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Connection: close Jul 25 23:21:08.619404 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Length: 0 Jul 25 23:21:08.619404 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Type: application/json Jul 25 23:21:08.619404 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Host: 10.222.0.55 Jul 25 23:21:08.619404 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Openstack-System-Scope: None Jul 25 23:21:08.619404 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: User-Agent: python-urllib3/1.26.10 Jul 25 23:21:08.619404 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Auth-Token: gAAAAABi3yPG_u6_VIlihooKP8ZYQokhoS8GVUA0c86aUw25vcv8StYqyh7P0MN5QPq8YHO5d5GVLyacWhqkguKxp-vluVaTPxynyU_BQw2_CDzcgH5Mz4DtdjfsldpGIwM8M2pES1x7Wekfa5dHqLyZ_m7TKxxDAFFrGTrh5_B42jrppfOaWCU Jul 25 23:21:08.619404 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Id: None Jul 25 23:21:08.619404 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Name: None Jul 25 23:21:08.619404 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Identity-Status: Confirmed Jul 25 23:21:08.619404 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Is-Admin-Project: True Jul 25 23:21:08.619404 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Id: default Jul 25 23:21:08.619404 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Name: Default Jul 25 23:21:08.619404 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Id: f661a74731894c6e94eced8d8f7520e7 Jul 25 23:21:08.619404 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Name: tempest-TestVolumeBootPattern-1273322900 Jul 25 23:21:08.619404 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Role: reader,member Jul 25 23:21:08.619404 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Roles: reader,member Jul 25 23:21:08.621328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f661a74731894c6e94eced8d8f7520e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/f661a74731894c6e94eced8d8f7520e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_f661a74731894c6e94eced8d8f7520e7", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/f661a74731894c6e94eced8d8f7520e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:21:08.621328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant: tempest-TestVolumeBootPattern-1273322900 Jul 25 23:21:08.621328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Id: f661a74731894c6e94eced8d8f7520e7 Jul 25 23:21:08.621328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Name: tempest-TestVolumeBootPattern-1273322900 Jul 25 23:21:08.621328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User: tempest-TestVolumeBootPattern-1273322900-project Jul 25 23:21:08.621328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Id: default Jul 25 23:21:08.621328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Name: Default Jul 25 23:21:08.621328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Id: c862a035745641b5a8dde92a3d570b35 Jul 25 23:21:08.621328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Name: tempest-TestVolumeBootPattern-1273322900-project Jul 25 23:21:08.621328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: method: > Jul 25 23:21:08.621328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: exception: Instance f900a476-26ad-48ba-95f9-eb96fa8b9dbe could not be found. Jul 25 23:21:08.621328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: action_args: {'id': 'f900a476-26ad-48ba-95f9-eb96fa8b9dbe'} Jul 25 23:21:08.622328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:21:08.622328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:21:08.622328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:21:08.622328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:21:08.622328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:21:08.622328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:21:08.622328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:21:08.622328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:21:08.622328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:21:08.622328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:21:08.622328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f900a476-26ad-48ba-95f9-eb96fa8b9dbe could not be found. Jul 25 23:21:08.622328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:21:08.622328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:21:08.622328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:21:08.622328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:21:08.622328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:21:08.622328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:21:08.622328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:21:08.622328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:21:08.622328 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:21:08.624063 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:21:08.624063 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 23:21:08.624063 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 23:21:08.624063 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:21:08.624063 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:21:08.624063 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:21:08.624063 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:21:08.624063 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f900a476-26ad-48ba-95f9-eb96fa8b9dbe could not be found. Jul 25 23:21:08.624063 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:21:08.624063 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:21:08.624063 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:21:08.624063 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:21:08.624063 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:21:08.624063 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:21:08.624063 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:21:08.624063 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:21:08.624063 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f900a476-26ad-48ba-95f9-eb96fa8b9dbe could not be found. Jul 25 23:21:08.624063 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:21:08.625815 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-2825a6cb-b6b1-4e3f-9b78-825115eab4f6 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Returning 404 to user: Instance f900a476-26ad-48ba-95f9-eb96fa8b9dbe could not be found. {{(pid=118409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:21:08.625815 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-2825a6cb-b6b1-4e3f-9b78-825115eab4f6 tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe" status: 404 len: 111 microversion: 2.1 time: 0.032532 Jul 25 23:21:08.625815 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 580/1163] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:21:08 2022] GET /compute/v2.1/servers/f900a476-26ad-48ba-95f9-eb96fa8b9dbe => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:21:10.139609 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-c2cebd83-247a-4741-8b4b-a8b2c25bb60a tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] Calling method '.version_select at 0x7f6226dc6670>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:21:10.222444 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-c2cebd83-247a-4741-8b4b-a8b2c25bb60a tempest-TestVolumeBootPattern-1273322900 tempest-TestVolumeBootPattern-1273322900-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1194749679" status: 202 len: 0 microversion: 2.1 time: 0.086622 Jul 25 23:21:10.223088 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 584/1164] 10.222.0.55 () {58 vars in 1263 bytes} [Mon Jul 25 23:21:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1194749679 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 23:21:56.254525 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-cc2d4b4e-bd6f-4b37-a1b4-4aae9260bd84 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:21:56.255108 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-cc2d4b4e-bd6f-4b37-a1b4-4aae9260bd84 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:21:56.257392 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:21:56.258043 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG dbcounter [-] [118409] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:21:56.265078 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [req-4a8b4ca8-c413-4a0b-b7b9-f0b3c56caf7b req-f5efc4ca-2af0-455a-85df-46d3e19afee2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aef45a51-92a9-46be-8adf-5d7d259dbe28", "tag": "0ea01c9b-495f-4404-af19-caa8c31834e3"}]} {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:21:56.271477 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:21:56.271665 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG dbcounter [-] [118410] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118410) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 23:21:56.276778 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cc2d4b4e-bd6f-4b37-a1b4-4aae9260bd84 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:21:56.277258 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cc2d4b4e-bd6f-4b37-a1b4-4aae9260bd84 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:21:56.278049 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cc2d4b4e-bd6f-4b37-a1b4-4aae9260bd84 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:21:56.278490 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-cc2d4b4e-bd6f-4b37-a1b4-4aae9260bd84 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:21:56.281437 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-4a8b4ca8-c413-4a0b-b7b9-f0b3c56caf7b req-f5efc4ca-2af0-455a-85df-46d3e19afee2 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:21:56.281883 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [req-4a8b4ca8-c413-4a0b-b7b9-f0b3c56caf7b req-f5efc4ca-2af0-455a-85df-46d3e19afee2 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:21:56.293488 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.compute.server_external_events [req-4a8b4ca8-c413-4a0b-b7b9-f0b3c56caf7b req-f5efc4ca-2af0-455a-85df-46d3e19afee2 service nova] Creating event network-changed:0ea01c9b-495f-4404-af19-caa8c31834e3 for instance aef45a51-92a9-46be-8adf-5d7d259dbe28 on hv-cinder-79760 Jul 25 23:21:56.299391 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [req-4a8b4ca8-c413-4a0b-b7b9-f0b3c56caf7b req-f5efc4ca-2af0-455a-85df-46d3e19afee2 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038028 Jul 25 23:21:56.305825 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 585/1165] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:21:56.314944 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-cc2d4b4e-bd6f-4b37-a1b4-4aae9260bd84 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Going to try to terminate instance {{(pid=118409) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 25 23:21:56.608632 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-cc2d4b4e-bd6f-4b37-a1b4-4aae9260bd84 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "DELETE /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 204 len: 0 microversion: 2.1 time: 0.358476 Jul 25 23:21:56.609560 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 581/1166] 10.222.0.55 () {58 vars in 1239 bytes} [Mon Jul 25 23:21:56 2022] DELETE /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 25 23:21:56.619191 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-03bb2854-ffe4-460c-a811-e3a8f6090405 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:21:56.619885 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-03bb2854-ffe4-460c-a811-e3a8f6090405 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:21:56.628711 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-03bb2854-ffe4-460c-a811-e3a8f6090405 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:21:56.629173 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-03bb2854-ffe4-460c-a811-e3a8f6090405 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:21:56.630015 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-03bb2854-ffe4-460c-a811-e3a8f6090405 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:21:56.630368 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-03bb2854-ffe4-460c-a811-e3a8f6090405 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:21:56.784998 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-03bb2854-ffe4-460c-a811-e3a8f6090405 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:21:56.792752 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-03bb2854-ffe4-460c-a811-e3a8f6090405 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1568 microversion: 2.1 time: 0.177724 Jul 25 23:21:56.793348 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 586/1167] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:21:56 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:21:57.817808 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-009ab3d8-f8dd-4cd3-a378-8a9941bc2b24 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:21:57.818490 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-009ab3d8-f8dd-4cd3-a378-8a9941bc2b24 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:21:57.824731 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-009ab3d8-f8dd-4cd3-a378-8a9941bc2b24 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:21:57.825201 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-009ab3d8-f8dd-4cd3-a378-8a9941bc2b24 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:21:57.825964 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-009ab3d8-f8dd-4cd3-a378-8a9941bc2b24 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:21:57.826391 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-009ab3d8-f8dd-4cd3-a378-8a9941bc2b24 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:21:58.043214 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.policy [None req-009ab3d8-f8dd-4cd3-a378-8a9941bc2b24 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118409) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:21:58.051939 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-009ab3d8-f8dd-4cd3-a378-8a9941bc2b24 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1568 microversion: 2.1 time: 0.239771 Jul 25 23:21:58.052531 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 582/1168] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:21:57 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1568 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:21:59.074538 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-1fbe483b-79ec-4d4d-ad32-209da5c4f452 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:21:59.075179 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-1fbe483b-79ec-4d4d-ad32-209da5c4f452 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:21:59.084982 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1fbe483b-79ec-4d4d-ad32-209da5c4f452 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:21:59.085510 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1fbe483b-79ec-4d4d-ad32-209da5c4f452 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:21:59.086244 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1fbe483b-79ec-4d4d-ad32-209da5c4f452 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:21:59.086723 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1fbe483b-79ec-4d4d-ad32-209da5c4f452 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:21:59.154147 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-1fbe483b-79ec-4d4d-ad32-209da5c4f452 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:21:59.161952 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-1fbe483b-79ec-4d4d-ad32-209da5c4f452 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1382 microversion: 2.1 time: 0.091361 Jul 25 23:21:59.162841 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 587/1169] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:21:59 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1382 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:21:59.287841 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [req-5c97f4c0-d104-4e4d-a847-adb50c1897b4 req-0ee85b0b-f4b2-4396-913b-f4f63726be80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aef45a51-92a9-46be-8adf-5d7d259dbe28", "name": "network-vif-deleted", "tag": "0ea01c9b-495f-4404-af19-caa8c31834e3"}]} {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 25 23:21:59.298484 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-5c97f4c0-d104-4e4d-a847-adb50c1897b4 req-0ee85b0b-f4b2-4396-913b-f4f63726be80 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:21:59.298924 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [req-5c97f4c0-d104-4e4d-a847-adb50c1897b4 req-0ee85b0b-f4b2-4396-913b-f4f63726be80 service nova] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:21:59.311166 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.compute.server_external_events [req-5c97f4c0-d104-4e4d-a847-adb50c1897b4 req-0ee85b0b-f4b2-4396-913b-f4f63726be80 service nova] Creating event network-vif-deleted:0ea01c9b-495f-4404-af19-caa8c31834e3 for instance aef45a51-92a9-46be-8adf-5d7d259dbe28 on hv-cinder-79760 Jul 25 23:21:59.316821 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [req-5c97f4c0-d104-4e4d-a847-adb50c1897b4 req-0ee85b0b-f4b2-4396-913b-f4f63726be80 service nova] 10.222.0.55 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.223696 Jul 25 23:21:59.317478 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 583/1170] 10.222.0.55 () {64 vars in 1317 bytes} [Mon Jul 25 23:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 25 23:22:00.184456 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-1a674f59-947c-4cdf-aa5f-ec1533b57a3d tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:22:00.185368 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.compute.api [None req-1a674f59-947c-4cdf-aa5f-ec1533b57a3d tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118410) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:22:00.195352 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1a674f59-947c-4cdf-aa5f-ec1533b57a3d tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:22:00.198371 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1a674f59-947c-4cdf-aa5f-ec1533b57a3d tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:22:00.198371 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1a674f59-947c-4cdf-aa5f-ec1533b57a3d tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:22:00.198371 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1a674f59-947c-4cdf-aa5f-ec1533b57a3d tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:22:00.235471 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1a674f59-947c-4cdf-aa5f-ec1533b57a3d tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:22:00.236084 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG oslo_concurrency.lockutils [None req-1a674f59-947c-4cdf-aa5f-ec1533b57a3d tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118410) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:22:00.236670 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.objects.instance [None req-1a674f59-947c-4cdf-aa5f-ec1533b57a3d tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lazy-loading 'fault' on Instance uuid aef45a51-92a9-46be-8adf-5d7d259dbe28 {{(pid=118410) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 25 23:22:00.296727 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.policy [None req-1a674f59-947c-4cdf-aa5f-ec1533b57a3d tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e64a691c048e091ae6a23b5edf048', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '249b4da896194c73b9ef659a254dea52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118410) authorize /opt/stack/nova/nova/policy.py:199}} Jul 25 23:22:00.306824 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-1a674f59-947c-4cdf-aa5f-ec1533b57a3d tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 200 len: 1225 microversion: 2.1 time: 0.126784 Jul 25 23:22:00.307487 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 588/1171] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:22:00 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 1225 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 25 23:22:01.332283 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-7b0159c6-7a67-4e98-84aa-76f4db7aa113 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '>' {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:22:01.332899 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.compute.api [None req-7b0159c6-7a67-4e98-84aa-76f4db7aa113 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] [instance: aef45a51-92a9-46be-8adf-5d7d259dbe28] Fetching instance by UUID {{(pid=118409) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 25 23:22:01.339593 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7b0159c6-7a67-4e98-84aa-76f4db7aa113 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:22:01.340039 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7b0159c6-7a67-4e98-84aa-76f4db7aa113 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:22:01.340812 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7b0159c6-7a67-4e98-84aa-76f4db7aa113 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 25 23:22:01.341335 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG oslo_concurrency.lockutils [None req-7b0159c6-7a67-4e98-84aa-76f4db7aa113 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Lock "53652832-e111-499c-ae59-8d3f8dfe286d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 25 23:22:01.356156 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.wsgi [None req-7b0159c6-7a67-4e98-84aa-76f4db7aa113 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] HTTP exception thrown: Instance aef45a51-92a9-46be-8adf-5d7d259dbe28 could not be found. Jul 25 23:22:01.357879 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-7b0159c6-7a67-4e98-84aa-76f4db7aa113 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Request method failure captured: Jul 25 23:22:01.357879 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: request: GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 HTTP/1.1 Jul 25 23:22:01.357879 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept: application/json Jul 25 23:22:01.357879 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Accept-Encoding: identity Jul 25 23:22:01.357879 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Connection: close Jul 25 23:22:01.357879 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Length: 0 Jul 25 23:22:01.357879 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Content-Type: application/json Jul 25 23:22:01.357879 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Host: 10.222.0.55 Jul 25 23:22:01.357879 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Openstack-System-Scope: None Jul 25 23:22:01.357879 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: User-Agent: python-urllib3/1.26.10 Jul 25 23:22:01.357879 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Auth-Token: gAAAAABi3ySC7BsEYcbS91Y-EWliSuTH1O0qr-xQ6fvFMy9Vc7WKozRTtY-UJnW381Aif-uarpKpVyymcfHJzxskU1UB7CQOFIpEtmOnLgVWPrsN7kppFDKdkZAkko-FnJBq4x8hCfIrGTH756VcF7bJwlUr5gZHtbMH7pV0dO6zOzd8VzvBugo Jul 25 23:22:01.357879 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Id: None Jul 25 23:22:01.357879 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Domain-Name: None Jul 25 23:22:01.357879 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Identity-Status: Confirmed Jul 25 23:22:01.357879 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Is-Admin-Project: True Jul 25 23:22:01.357879 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Id: default Jul 25 23:22:01.357879 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Domain-Name: Default Jul 25 23:22:01.357879 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Id: 249b4da896194c73b9ef659a254dea52 Jul 25 23:22:01.357879 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Project-Name: tempest-TestShelveInstance-2102821636 Jul 25 23:22:01.357879 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Role: reader,member Jul 25 23:22:01.357879 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Roles: reader,member Jul 25 23:22:01.359657 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/249b4da896194c73b9ef659a254dea52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/volume/v3/249b4da896194c73b9ef659a254dea52"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55:8080/v1/AUTH_249b4da896194c73b9ef659a254dea52", "adminURL": "http://10.222.0.55:8080"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2/249b4da896194c73b9ef659a254dea52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.55/compute/v2.1"}]}] Jul 25 23:22:01.359657 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant: tempest-TestShelveInstance-2102821636 Jul 25 23:22:01.359657 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Id: 249b4da896194c73b9ef659a254dea52 Jul 25 23:22:01.359657 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-Tenant-Name: tempest-TestShelveInstance-2102821636 Jul 25 23:22:01.359657 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User: tempest-TestShelveInstance-2102821636-project Jul 25 23:22:01.359657 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Id: default Jul 25 23:22:01.359657 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Domain-Name: Default Jul 25 23:22:01.359657 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Id: e86e64a691c048e091ae6a23b5edf048 Jul 25 23:22:01.359657 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: X-User-Name: tempest-TestShelveInstance-2102821636-project Jul 25 23:22:01.359657 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: method: > Jul 25 23:22:01.359657 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: exception: Instance aef45a51-92a9-46be-8adf-5d7d259dbe28 could not be found. Jul 25 23:22:01.359657 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: action_args: {'id': 'aef45a51-92a9-46be-8adf-5d7d259dbe28'} Jul 25 23:22:01.360795 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: {{(pid=118409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 25 23:22:01.360795 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:22:01.360795 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 25 23:22:01.360795 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 25 23:22:01.360795 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 25 23:22:01.360795 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 25 23:22:01.360795 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 25 23:22:01.360795 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 25 23:22:01.360795 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 25 23:22:01.360795 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 25 23:22:01.360795 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aef45a51-92a9-46be-8adf-5d7d259dbe28 could not be found. Jul 25 23:22:01.360795 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:22:01.360795 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:22:01.360795 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:22:01.360795 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:22:01.360795 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:22:01.360795 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:22:01.360795 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 25 23:22:01.360795 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 25 23:22:01.360795 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 25 23:22:01.363414 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 25 23:22:01.363414 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 25 23:22:01.363414 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 25 23:22:01.363414 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 25 23:22:01.363414 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 25 23:22:01.363414 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 25 23:22:01.363414 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 25 23:22:01.363414 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aef45a51-92a9-46be-8adf-5d7d259dbe28 could not be found. Jul 25 23:22:01.363414 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:22:01.363414 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 25 23:22:01.363414 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:22:01.363414 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 25 23:22:01.363414 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 25 23:22:01.363414 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 25 23:22:01.363414 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 25 23:22:01.363414 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 25 23:22:01.363414 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aef45a51-92a9-46be-8adf-5d7d259dbe28 could not be found. Jul 25 23:22:01.363414 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: ERROR nova.api.openstack.wsgi Jul 25 23:22:01.364973 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: DEBUG nova.api.openstack.wsgi [None req-7b0159c6-7a67-4e98-84aa-76f4db7aa113 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Returning 404 to user: Instance aef45a51-92a9-46be-8adf-5d7d259dbe28 could not be found. {{(pid=118409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 25 23:22:01.364973 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO nova.api.openstack.requestlog [None req-7b0159c6-7a67-4e98-84aa-76f4db7aa113 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28" status: 404 len: 111 microversion: 2.1 time: 0.032759 Jul 25 23:22:01.364973 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: [pid: 118409|app: 0|req: 584/1172] 10.222.0.55 () {58 vars in 1236 bytes} [Mon Jul 25 23:22:01 2022] GET /compute/v2.1/servers/aef45a51-92a9-46be-8adf-5d7d259dbe28 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 25 23:22:01.668711 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: DEBUG nova.api.openstack.wsgi [None req-0de8f62f-1ec9-4a5a-93f0-9c48174e9459 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] Calling method '.version_select at 0x7f6226e20dc0>' {{(pid=118410) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 25 23:22:01.776307 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO nova.api.openstack.requestlog [None req-0de8f62f-1ec9-4a5a-93f0-9c48174e9459 tempest-TestShelveInstance-2102821636 tempest-TestShelveInstance-2102821636-project] 10.222.0.55 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1781200558" status: 202 len: 0 microversion: 2.1 time: 0.114359 Jul 25 23:22:01.776922 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: [pid: 118410|app: 0|req: 589/1173] 10.222.0.55 () {58 vars in 1254 bytes} [Mon Jul 25 23:22:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1781200558 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 25 23:22:29.557588 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 23:22:29.558238 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Mon Jul 25 23:22:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 23:24:05.252431 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 23:24:05.253089 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Mon Jul 25 23:24:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 23:24:23.725560 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 23:24:23.726129 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Mon Jul 25 23:24:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 23:24:26.133175 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 23:24:26.134214 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Mon Jul 25 23:24:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 23:25:44.812032 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 23:25:44.812654 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Mon Jul 25 23:25:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 23:25:49.567054 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 23:25:49.567704 dv-cinder-797608-63-iscsi devstack@n-api.service[118409]: Mon Jul 25 23:25:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 23:27:25.261565 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 23:27:25.262213 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Mon Jul 25 23:27:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 25 23:27:29.403444 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 25 23:27:29.404099 dv-cinder-797608-63-iscsi devstack@n-api.service[118410]: Mon Jul 25 23:27:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!